-- Logs begin at Sat 2022-07-16 11:59:19 UTC, end at Sat 2022-07-16 13:17:49 UTC. -- Jul 16 12:39:33.314876 dv-cinder-836973-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 16 12:39:33.323689 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 16 12:39:33 2022] *** Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: nodename: dv-cinder-836973-12-iscsi Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: machine: x86_64 Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: clock source: unix Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: pcre jit disabled Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: detected number of CPU cores: 4 Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: current working directory: / Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: detected binary path: /usr/bin/uwsgi-core Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: your processes number limit is 47680 Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: your memory page size is 4096 bytes Jul 16 12:39:33.326355 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: detected max file descriptor number: 2048 Jul 16 12:39:33.330386 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: lock engine: pthread robust mutexes Jul 16 12:39:33.330386 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: thunder lock: enabled Jul 16 12:39:33.330386 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 16 12:39:33.330386 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 16 12:39:33.366323 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: Python main interpreter initialized at 0x556063cef9c0 Jul 16 12:39:33.366323 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: python threads support enabled Jul 16 12:39:33.366323 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: your server socket listen backlog is limited to 100 connections Jul 16 12:39:33.366323 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: your mercy for graceful operations on workers is 90 seconds Jul 16 12:39:33.366663 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: mapped 403077 bytes (393 KB) for 2 cores Jul 16 12:39:33.366741 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: *** Operational MODE: preforking *** Jul 16 12:39:33.366969 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: *** uWSGI is running in multiple interpreter mode *** Jul 16 12:39:33.366969 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: spawned uWSGI master process (pid: 110104) Jul 16 12:39:33.369680 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: spawned uWSGI worker 1 (pid: 110105, cores: 1) Jul 16 12:39:33.369680 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: spawned uWSGI worker 2 (pid: 110106, cores: 1) Jul 16 12:39:33.369680 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 16 12:39:33.367155 dv-cinder-836973-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 16 12:39:34.035790 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 16 12:39:34.064261 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 16 12:39:35.127860 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:39:35.127860 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: from cryptography.utils import int_from_bytes Jul 16 12:39:35.128452 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:39:35.128452 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: from cryptography.utils import int_from_bytes Jul 16 12:39:35.166583 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:39:35.166583 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: from cryptography.utils import int_from_bytes Jul 16 12:39:35.167085 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:39:35.167085 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: from cryptography.utils import int_from_bytes Jul 16 12:39:37.609659 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 12:39:37.610181 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 12:39:37.610431 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 12:39:37.610794 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 12:39:37.611047 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 12:39:37.611432 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.611758 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.612078 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.612396 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.612727 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.613058 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.613382 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.613704 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.614030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.614293 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.614610 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.614937 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-12-iscsi {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.615031 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 12:39:37.615392 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.615483 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 12:39:37.615571 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.615794 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 12:39:37.615882 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.616154 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.616241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 12:39:37.616408 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 12:39:37.616494 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.616767 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.616852 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.617100 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.617207 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.617444 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.617606 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618000 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618142 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618251 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618387 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618508 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618768 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.618983 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619107 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619293 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619382 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619549 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619709 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619862 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.619992 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.620183 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-12-iscsi {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.620283 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.620503 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.620604 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.620807 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.620903 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.621136 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.621245 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-12-iscsi {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.621453 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.621550 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.621755 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.621853 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.622072 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.622192 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.622679 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.622924 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.623069 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.623384 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.623484 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.623710 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.623809 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624029 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624126 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624336 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624433 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624662 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624793 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.624973 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.625094 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.625306 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.625395 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.625624 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.625713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.625930 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626028 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626238 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626324 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626542 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626637 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626859 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.626945 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-12-iscsi {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.627166 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.627253 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.627472 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.627560 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.627724 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.627838 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.628030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.628245 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.628343 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.628552 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.628666 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.628857 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629001 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629189 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629277 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629507 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629595 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629808 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.629904 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.630134 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.630222 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.630441 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.630536 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.630750 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.630890 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631056 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631153 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631352 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631447 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631657 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631755 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.631958 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632044 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632261 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632396 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632561 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632657 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632860 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.632960 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.633132 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.633222 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.633438 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.633539 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.633756 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.633844 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634073 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634168 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634392 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634483 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634640 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634736 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.634886 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635019 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635201 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635359 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635519 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635678 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635812 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.635988 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.636113 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.636307 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.636417 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.636627 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.636714 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.636932 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.637020 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.637263 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.637363 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.637569 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.637664 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.637938 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.638341 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.638476 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.638652 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.638749 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.638903 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.639053 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.639206 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.639377 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.639511 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.639684 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.639830 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640004 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640135 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640400 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640495 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640651 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640747 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.640954 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.641100 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.641317 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.641417 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.641626 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.641722 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.641930 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642016 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642233 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642330 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642539 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642636 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642840 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.642925 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.643142 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.643233 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.643441 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.643612 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.643744 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.643879 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644063 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644151 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644361 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644453 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644609 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644697 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644906 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.644993 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.645232 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.645322 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.645548 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.645645 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.645851 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.645939 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.646154 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.646242 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.646456 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.646543 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.646755 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.646851 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647063 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647152 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647366 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647452 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647665 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647751 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.647967 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648063 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648268 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648356 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648568 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648656 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648872 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.648961 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.649196 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.649286 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.649498 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.649601 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.649805 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.649891 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.650111 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.650198 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.650410 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.650504 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.650708 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.650794 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651006 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651101 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651306 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651404 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651609 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651697 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651907 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.651992 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.652202 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.652296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.652513 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.652607 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.652813 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.652900 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.653136 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.653239 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.653991 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.654126 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.654607 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.654706 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.654919 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.655016 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.655237 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.655334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.655537 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.655658 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.655844 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.656012 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.656146 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.656326 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.656452 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.656658 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.656758 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.656993 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.657113 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.657338 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.657433 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.657644 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.657738 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.657946 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.658046 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.658245 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.658342 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.658542 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.658638 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.658838 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.658924 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.659150 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.659237 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.659467 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.659574 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.659771 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.659869 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.660072 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.660166 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.660374 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.660465 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.660688 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:39:37.660776 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661003 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661122 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661344 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661434 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661663 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661751 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.661974 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.662061 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.662324 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.662455 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.662614 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.662722 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.662929 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663016 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663238 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663327 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663547 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663647 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663869 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.663965 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.664175 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.664263 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.664483 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.664572 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.664789 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.664960 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.665122 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.665225 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.665437 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.665523 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.665764 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.665863 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666072 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666159 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666383 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666470 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666693 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666788 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.666996 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.667090 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.667303 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.667391 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.667615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.667710 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.667928 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668017 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668234 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668333 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668566 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668653 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668889 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.668978 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.670060 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.670234 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.670389 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.670572 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.670708 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.670897 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671025 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671209 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671341 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671521 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671654 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671831 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.671962 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.672151 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.672273 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.672479 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.672575 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.672788 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.672916 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.673128 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.673232 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.673443 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.673531 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.673753 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.673842 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.674065 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.674154 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.674376 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.674467 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.674686 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.674781 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675022 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675111 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675330 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675417 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675636 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675730 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.675942 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676029 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676250 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676345 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676554 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676862 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.676950 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.677194 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.677296 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.677499 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.677595 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.677798 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.677885 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.678105 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.678201 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.678411 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.678509 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.678709 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.678804 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679023 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679109 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679335 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679432 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679634 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679721 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.679951 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680037 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680252 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680346 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680558 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680646 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680863 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.680952 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.681191 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.681293 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.681495 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.681583 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.681803 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.681890 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.682107 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.682196 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.682411 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.682500 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.682731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.682819 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683037 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683125 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683338 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683425 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683641 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683736 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.683944 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.684031 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.684246 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.684333 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.684555 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.684704 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.684906 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.685243 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.685463 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.685553 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.685786 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.685885 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.686104 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.686256 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.686417 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.686516 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.686732 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.686827 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687036 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687130 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687339 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687430 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687642 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687732 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.687982 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.688069 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.688284 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.688414 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.688605 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.688693 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.688926 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689021 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689265 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689353 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689571 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689669 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689880 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.689967 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.690185 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.690332 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.690478 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.690618 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.690771 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.690905 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691067 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691208 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691367 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691507 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691668 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691802 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.691969 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.692115 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.692272 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.692405 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.692572 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.692717 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.692889 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693102 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693242 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693392 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693526 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693662 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693803 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.693947 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.694089 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.694223 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.694404 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.694495 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.694706 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.694925 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695073 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695207 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695362 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695499 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695670 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695811 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.695985 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.696131 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.696290 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.696379 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.696598 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.696743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.696901 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697031 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697235 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697367 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697543 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697680 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697850 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.697986 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.698164 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.698300 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.698468 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.698599 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.698783 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.698915 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.699087 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.699227 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.699406 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.699539 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.699717 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.699854 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.700030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.700175 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.700394 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.700727 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.700968 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.701231 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.701323 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.701548 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.701638 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.701871 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.701958 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.702184 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.702272 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.702495 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.702584 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.702806 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.702894 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.703364 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.703468 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.703669 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.703757 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.703979 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704066 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704286 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704381 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704682 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704902 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.704995 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.705232 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.705332 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.705546 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.705641 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.705851 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.705945 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.706155 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.706251 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.706460 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.706549 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.706771 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.706858 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.707077 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.707175 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.707386 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.707479 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.707709 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.707795 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708029 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708124 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708336 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708424 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708643 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708729 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.708963 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.709071 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.709296 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.709383 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.709608 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.709708 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.709915 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710002 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710216 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710308 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710517 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710606 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710825 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.710921 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.711139 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.711227 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.711448 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.711545 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.711757 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.711853 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712062 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712148 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712369 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712465 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712674 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712767 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.712973 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.713100 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.713300 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.713403 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.713609 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.713705 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.713916 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714009 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714225 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714321 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714532 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714622 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714843 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.714983 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.715130 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.715279 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.715424 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.715559 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.715733 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.715877 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.716674 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.716967 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.717123 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.717311 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.717443 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.717621 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.717767 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.717924 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.718067 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.718268 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.718495 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.718628 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.718831 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.718964 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.719148 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.719281 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.719469 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.719611 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.719774 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.719910 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.720086 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.720220 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.720394 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.720540 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.720702 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.720836 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721021 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721215 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721363 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721510 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721654 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721790 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.721925 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.722071 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.722227 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.722372 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.722588 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.722724 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.722868 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723010 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723146 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723281 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723426 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723562 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723705 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.723840 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724011 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724149 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724433 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724604 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724741 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.724894 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.725056 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.725245 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.725491 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.725626 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.725822 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.725961 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.726137 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.726275 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.726452 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.726585 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.726763 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.726877 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.727068 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.727162 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.727371 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.727470 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.727677 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.727772 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728018 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728106 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728320 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728414 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728632 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728733 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.728938 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.729068 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.729271 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.729359 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.729581 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.729668 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.729885 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730010 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730188 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730275 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730492 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730591 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730797 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.730886 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.731098 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.731184 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.731397 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.731484 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.732254 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.732565 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.732687 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.732872 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.732984 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.733207 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.733311 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.733520 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.733607 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.733832 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.733920 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.734138 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.734227 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.734448 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.734543 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.734752 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.734839 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735068 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735165 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735376 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735462 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735677 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735763 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.735981 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.736073 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.736292 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.736378 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.736601 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.736688 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.736907 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737009 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737240 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737330 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737544 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737640 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737864 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.737949 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.738167 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.738253 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.738472 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.738568 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.738771 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.738857 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739080 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739179 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739479 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739684 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739769 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.739984 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740085 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740291 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740387 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740598 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740697 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740898 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.740984 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.741223 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.741312 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.741525 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.741611 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.741824 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.741916 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.742121 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.742208 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.742431 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.742518 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.742736 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.742822 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743035 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743122 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743334 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743421 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743636 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743720 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.743936 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744023 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744236 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744323 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744540 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744640 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744842 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.744927 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.745171 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.745260 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.745474 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.745570 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.745773 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.745859 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746073 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746159 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746378 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746474 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746682 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746785 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.746985 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.747083 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.747921 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.748326 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.748415 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.748646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.748732 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.748955 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.749075 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.749284 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.749374 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.749592 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.749679 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.749902 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750081 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750208 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750303 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750515 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750620 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750836 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.750941 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.751151 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.751238 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.751451 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.751537 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.751757 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.751852 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752060 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752148 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752363 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752456 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752666 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752752 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.752970 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753085 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753297 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753396 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753599 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753693 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753900 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.753995 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.754204 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.754290 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.754507 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.754594 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.754827 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.754923 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.755136 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.755273 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.755436 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.755522 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.755738 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.755826 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756039 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756134 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756347 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756433 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756656 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.756967 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.757142 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.757306 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.757394 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.757620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.757705 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.757931 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758030 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758235 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758328 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758537 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758629 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758844 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.758946 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.759145 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.759268 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.759447 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.759565 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.759755 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.759872 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760064 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760151 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760364 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760451 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760666 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760766 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.760966 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.761110 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.761303 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.761391 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.761606 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.761695 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.761922 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.762036 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.762243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.762338 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.762567 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.762664 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.763625 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.763725 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.763958 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.764084 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.764266 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.764440 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.764585 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.764780 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.764902 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.765142 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.765234 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.765478 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.765639 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.765809 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.765951 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.766139 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.766264 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.766467 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.766561 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.766797 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.766895 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.767122 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.767248 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.767443 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.767531 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.767764 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.767861 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768069 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768156 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768372 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768459 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768674 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768769 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.768996 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.769133 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.769325 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.769414 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.769647 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.769741 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.769963 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.770050 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.770282 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.770369 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.770595 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.770690 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771032 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771119 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771353 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771438 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771665 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771753 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.771975 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.772060 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.772294 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.772381 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.772614 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.772702 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.772929 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773028 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773259 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773347 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773572 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773660 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773898 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.773985 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.774223 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.774310 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.774534 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.774622 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.774847 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.774941 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.775152 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.775239 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.775477 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.775572 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.775801 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.775888 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.776115 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.776210 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.776425 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.776509 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.776736 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.776829 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.777137 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.777259 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.777398 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.777493 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.777690 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.777785 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.778019 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.778120 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.778376 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.778492 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.778764 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.779075 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.779162 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.779421 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.779513 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.779731 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.779826 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780045 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780134 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780373 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780461 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780680 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780769 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.780993 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.781102 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.781333 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.781434 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.781644 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.781732 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.781949 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782037 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782255 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782356 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782580 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782668 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782885 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.782973 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.783200 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.783295 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.783513 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.783608 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.783832 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.783919 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.784154 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.784251 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.784461 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.784549 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.784782 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.784869 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.785114 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.785218 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.785422 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.785545 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.785728 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.785862 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786032 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786372 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786518 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786677 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786830 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.786993 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.787141 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.787312 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.787489 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.787628 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.787772 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.787937 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.788082 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.788269 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.788414 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.788594 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.788739 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.788909 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.789076 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.789253 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.789386 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.789576 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.789726 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.789887 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790019 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790154 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790289 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790468 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790654 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790791 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.790925 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791066 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791196 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791351 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791496 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791658 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791797 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.791960 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.792092 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.792263 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.792406 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.792566 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.792698 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.792886 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793018 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793219 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793352 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793526 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793663 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793840 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.793972 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.794173 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.794278 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.794453 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.794588 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.794750 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.794882 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.795093 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.795225 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.795398 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.795530 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.795733 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.795881 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.796051 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.796189 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.796374 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.796524 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.796693 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.796834 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797003 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797176 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797352 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797488 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797661 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797829 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.797970 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798058 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798281 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798375 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798587 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798682 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798897 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.798985 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.799206 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.799300 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.799516 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.799603 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.799823 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.799907 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.800133 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.800219 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.800445 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.800534 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.800758 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.800845 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.801151 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.801293 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.801480 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.801619 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.801794 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.801934 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.802104 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.802248 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.802414 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.802560 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.802719 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.802873 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.803066 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.803186 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.803374 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.803496 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.803716 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.803803 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.804040 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.804136 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.804368 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.804455 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.804699 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.804785 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.805012 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.805230 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.805363 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.805450 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.805681 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.805767 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806001 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806089 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806316 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806402 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806633 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806719 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.806948 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807034 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807263 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807349 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807582 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807727 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807895 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.807983 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.808209 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.808295 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.808524 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.808619 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.808839 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.809245 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.809401 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.809564 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.810308 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.810402 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.810709 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.810947 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811040 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811121 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811318 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811408 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811633 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811720 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.811948 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.812050 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.812271 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.812359 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.812606 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.812693 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.812919 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813014 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813259 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813348 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813575 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813663 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813892 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.813992 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.814224 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.814412 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.814564 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.814729 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.814887 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.815062 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.815209 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.815388 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.815530 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.815714 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.815851 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816214 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816349 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816533 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816678 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816847 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.816985 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.817191 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.817317 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.817513 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.817631 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.817834 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.817938 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.818150 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.818244 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.818464 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.818566 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.818785 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.818879 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.819105 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.819205 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.819420 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.819516 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.819726 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.819813 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.820041 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.820331 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.820446 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.820610 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.820699 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.820927 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.821014 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.821279 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.821380 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.821605 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.821694 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.821922 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.822011 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.822232 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.822329 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.822558 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.822774 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.822862 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.823095 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.823192 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.823435 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.823525 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.823751 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.823846 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824056 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824152 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824360 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824456 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824670 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824758 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.824978 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.825111 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.825908 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826150 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826237 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826318 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826533 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826630 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826849 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.826936 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.827161 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.827256 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.827481 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.827568 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.827787 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.827922 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.828355 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.828454 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.828658 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.828746 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.828964 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.829072 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.829307 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.829533 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.829630 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.829886 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.829973 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.830197 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.830286 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.830513 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.830626 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.830814 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.830902 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.831123 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.831218 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.831428 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.831573 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.831737 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.831826 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832067 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832154 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832380 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832469 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832693 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832786 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.832996 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.833146 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.833328 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.833424 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.833635 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.833729 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.833948 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834034 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834256 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834343 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834561 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834646 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834874 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.834974 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.835181 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.835268 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.835509 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.835727 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.835814 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.836068 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.836158 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.836391 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.836479 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.836706 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.836791 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837015 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837185 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837346 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837441 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837654 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837742 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.837961 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838048 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838272 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838358 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838580 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838681 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838891 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.838976 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.839196 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.839289 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.839505 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.839600 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.839810 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.839896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.840117 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.840210 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.840433 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.840543 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.840748 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.840848 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.841093 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.841206 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.841404 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.841505 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.841723 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.841821 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842036 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842124 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842351 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842438 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842665 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842758 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.842979 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.843066 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.843308 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.843404 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.843626 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.843714 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.843943 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.844160 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.844257 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.844497 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.844584 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.844820 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.844906 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.845178 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.845286 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.845489 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.845625 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.845806 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.845893 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.846111 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.846198 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.846420 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.846508 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.846729 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.846816 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847046 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847133 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847359 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847446 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847672 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847759 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.847988 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.848122 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.848300 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.848387 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.848612 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.848708 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.848925 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849012 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849262 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849352 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849576 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849672 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849887 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.849973 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.850200 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.850287 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.850512 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.850608 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.850824 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.850920 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.851142 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.851230 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.851459 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.851547 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.851766 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.851860 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.852073 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.852160 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.852381 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.852469 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.852698 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.852785 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853008 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853178 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853339 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853427 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853643 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853739 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.853954 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854048 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854255 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854348 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854557 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854644 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854860 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.854956 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.855164 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.855252 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.855474 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.855590 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.855779 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.855909 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.856082 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.856232 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.856387 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.857103 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.857242 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.857477 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.857603 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.857809 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.857899 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.858134 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.858229 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.858437 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.858525 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.858741 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.858829 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859045 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859141 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859347 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859436 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859650 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859779 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.859983 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.860081 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.860317 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.860404 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.860634 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.860722 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.860946 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.861057 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.861280 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.861370 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.861593 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.861688 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.861900 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862003 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862212 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862298 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862522 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862668 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862830 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.862921 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.863136 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.863229 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.863444 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.863536 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.863750 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.863839 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864057 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864144 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864362 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864458 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864672 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864758 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.864978 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.865126 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.865311 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.865471 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.865619 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.865708 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.865928 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866016 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866234 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866541 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866629 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866851 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.866946 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.867160 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.867249 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.867467 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.867555 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.867772 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.867861 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.868081 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.868170 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.868388 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.868477 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.868696 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.868782 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869005 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869167 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869341 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869430 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869653 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869739 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.869969 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870057 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870279 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870367 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870589 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870686 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870906 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.870998 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.871224 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.871320 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.871540 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.871634 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.871853 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.871996 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.872220 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.872809 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.873237 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.873554 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.873767 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.873896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.874095 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.874251 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.874414 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.874573 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.874731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.874923 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.875050 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.875258 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.875383 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.875579 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.875715 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.875897 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.876027 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.876208 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.876360 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.876450 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 12:39:37.876685 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.877010 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.877355 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.877673 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.878007 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.878321 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.878677 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.878993 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.879309 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.879625 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.879945 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.880258 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.880572 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.880893 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.881243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.881577 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.881908 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.882223 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.882551 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.882881 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.883231 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.883554 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.883900 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.884232 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.884552 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.884867 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.885205 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:39:37.885454 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 12:39:37.938210 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO dbcounter [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Registered counter for database nova_api Jul 16 12:39:37.948565 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO dbcounter [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Registered counter for database nova_api Jul 16 12:39:38.052035 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_db.sqlalchemy.engines [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.058558 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writer thread running {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.061362 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_db.sqlalchemy.engines [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.067633 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writer thread running {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.115002 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.context [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7da9c633-d1e3-4a76-a464-f6bb00d1ecba(cell1) {{(pid=110106) load_cells /opt/stack/nova/nova/context.py:464}} Jul 16 12:39:38.118903 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:39:38.120463 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:39:38.121282 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:39:38.123941 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.context [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7da9c633-d1e3-4a76-a464-f6bb00d1ecba(cell1) {{(pid=110105) load_cells /opt/stack/nova/nova/context.py:464}} Jul 16 12:39:38.124056 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:39:38.125903 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO dbcounter [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Registered counter for database nova_cell0 Jul 16 12:39:38.127892 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_concurrency.lockutils [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:39:38.129561 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_concurrency.lockutils [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:39:38.129859 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO dbcounter [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Registered counter for database nova_cell1 Jul 16 12:39:38.130386 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_concurrency.lockutils [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:39:38.132507 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_concurrency.lockutils [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:39:38.134506 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO dbcounter [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Registered counter for database nova_cell0 Jul 16 12:39:38.138030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_db.sqlalchemy.engines [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.138436 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO dbcounter [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Registered counter for database nova_cell1 Jul 16 12:39:38.139506 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_db.sqlalchemy.engines [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.145754 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_db.sqlalchemy.engines [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.146849 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writer thread running {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.147185 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writer thread running {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.147454 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_db.sqlalchemy.engines [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.153354 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writer thread running {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.155687 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writer thread running {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.293895 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO dbcounter [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Registered counter for database nova_cell0 Jul 16 12:39:38.301177 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO dbcounter [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Registered counter for database nova_cell0 Jul 16 12:39:38.303191 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_db.sqlalchemy.engines [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.307538 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writer thread running {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.310170 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG oslo_db.sqlalchemy.engines [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:39:38.314978 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writer thread running {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:39:38.734329 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: WARNING keystonemiddleware.auth_token [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:39:38.741707 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: WARNING keystonemiddleware.auth_token [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:39:38.748463 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: WARNING keystonemiddleware.auth_token [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:39:38.755787 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: WARNING keystonemiddleware.auth_token [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:39:39.083719 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: WARNING keystonemiddleware.auth_token [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:39:39.089580 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: WARNING keystonemiddleware.auth_token [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:39:39.095348 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556063cef9c0 pid: 110106 (default app) Jul 16 12:39:39.097427 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:39:39.098341 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: WARNING keystonemiddleware.auth_token [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:39:39.098606 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 Jul 16 12:39:39.099026 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Sat Jul 16 12:39:39 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:39:39.104257 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: WARNING keystonemiddleware.auth_token [None req-5005460b-cc03-42cb-9e52-8d9f9a435bcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:39:39.110043 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556063cef9c0 pid: 110105 (default app) Jul 16 12:40:57.636419 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:40:57.637506 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 16 12:40:57.638095 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:40:57.650051 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writing DB stats nova_api:SELECT=3 {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:40:57.651204 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writing DB stats nova_cell1:SELECT=3 {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:40:57.652053 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writing DB stats nova_cell0:SELECT=3 {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:40:57.653126 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:40:58.521406 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-6767abdc-3e16-470a-be5e-f63dd61a059d admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:40:58.550439 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-6767abdc-3e16-470a-be5e-f63dd61a059d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905824 Jul 16 12:40:58.551250 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Sat Jul 16 12:40:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:00.802257 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:00.803258 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-fe26eeea-c8d2-4919-8229-8ab16d3fc709 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 16 12:41:00.803890 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:01.295064 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-206f0140-4e85-4378-80b2-4a9a11e72b9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:01.314318 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:41:01.314318 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: warnings.warn(msg) Jul 16 12:41:01.402543 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-206f0140-4e85-4378-80b2-4a9a11e72b9e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.591622 Jul 16 12:41:01.403013 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:01.417008 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_api:SELECT=3 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:41:01.421295 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_cell1:SELECT=3 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:41:01.421295 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_cell0:SELECT=3 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:41:01.421295 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:41:01.625658 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-025508a6-4403-479a-9623-0841810deed3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:01.628075 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:41:01.628075 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: warnings.warn(msg) Jul 16 12:41:01.781478 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-025508a6-4403-479a-9623-0841810deed3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369839 Jul 16 12:41:01.782100 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Sat Jul 16 12:41:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:04.007886 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-206f0140-4e85-4378-80b2-4a9a11e72b9e admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:04.008928 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-206f0140-4e85-4378-80b2-4a9a11e72b9e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 16 12:41:04.009606 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:04.673704 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-a8237d2a-ee19-4958-81cf-b58cd3b73fcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:04.692030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:41:04.692030 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: warnings.warn(msg) Jul 16 12:41:04.798336 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-a8237d2a-ee19-4958-81cf-b58cd3b73fcf admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781804 Jul 16 12:41:04.805319 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:04.812637 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-d0b0b6bd-2566-484a-9ef9-b86755743be4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:04.814420 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:41:04.814420 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: warnings.warn(msg) Jul 16 12:41:04.970449 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-d0b0b6bd-2566-484a-9ef9-b86755743be4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.161750 Jul 16 12:41:04.971233 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Sat Jul 16 12:41:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:07.217085 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-a8237d2a-ee19-4958-81cf-b58cd3b73fcf admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:07.217085 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-a8237d2a-ee19-4958-81cf-b58cd3b73fcf admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 16 12:41:07.217085 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:07.613638 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-5731eb9d-17cc-4496-bf31-d0c4b4cdb7fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:07.684633 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-5731eb9d-17cc-4496-bf31-d0c4b4cdb7fd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458147 Jul 16 12:41:07.685606 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:07.697238 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-243bf6e9-9fec-49ab-98c0-f39c0ede9a55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:07.771041 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-243bf6e9-9fec-49ab-98c0-f39c0ede9a55 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077458 Jul 16 12:41:07.771634 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Sat Jul 16 12:41:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:10.019865 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-5731eb9d-17cc-4496-bf31-d0c4b4cdb7fd admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:10.020866 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-5731eb9d-17cc-4496-bf31-d0c4b4cdb7fd admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 16 12:41:10.021478 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:10.483909 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-b6df1cab-ebe7-4575-b4eb-e0dff42c51e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:10.567496 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-b6df1cab-ebe7-4575-b4eb-e0dff42c51e7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540432 Jul 16 12:41:10.568042 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:10.581480 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-efae972f-e102-4550-a7a0-d2bafaa9f3d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:10.680021 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-efae972f-e102-4550-a7a0-d2bafaa9f3d0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102493 Jul 16 12:41:10.680757 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Sat Jul 16 12:41:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:41:12.889204 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-b6df1cab-ebe7-4575-b4eb-e0dff42c51e7 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:12.890204 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-b6df1cab-ebe7-4575-b4eb-e0dff42c51e7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 16 12:41:12.890598 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:13.326137 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-a9584e3f-a195-40bc-b590-66e03edc9f01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 20, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:13.442985 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-a9584e3f-a195-40bc-b590-66e03edc9f01 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546116 Jul 16 12:41:13.443986 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:13.456859 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-0c35ec75-0321-4efe-93c1-9fc5423a06c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:13.547171 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-0c35ec75-0321-4efe-93c1-9fc5423a06c4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093929 Jul 16 12:41:13.547748 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Sat Jul 16 12:41:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:15.928520 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-a9584e3f-a195-40bc-b590-66e03edc9f01 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:15.929562 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-a9584e3f-a195-40bc-b590-66e03edc9f01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 16 12:41:15.929971 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:16.359996 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-b731466f-a041-4c16-872c-5b23a52b7117 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:16.393333 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-b731466f-a041-4c16-872c-5b23a52b7117 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456288 Jul 16 12:41:16.394057 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Sat Jul 16 12:41:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:41:18.686863 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-a9584e3f-a195-40bc-b590-66e03edc9f01 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:18.688221 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-a9584e3f-a195-40bc-b590-66e03edc9f01 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002295 Jul 16 12:41:18.688737 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:19.133606 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-7188844b-6959-4889-88e9-72145e0d0454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny"}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:19.210497 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-7188844b-6959-4889-88e9-72145e0d0454 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.514195 Jul 16 12:41:19.211045 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:19.224536 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-ce6c32ec-9aa8-4961-b64d-ba28c4fa1188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:19.305623 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-ce6c32ec-9aa8-4961-b64d-ba28c4fa1188 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085981 Jul 16 12:41:19.306800 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Sat Jul 16 12:41:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:41:21.554542 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-7188844b-6959-4889-88e9-72145e0d0454 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:21.555586 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-7188844b-6959-4889-88e9-72145e0d0454 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 16 12:41:21.555993 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:21.955602 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-dbae833e-ce38-4e59-88a5-abd72c441878 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:22.021263 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-dbae833e-ce38-4e59-88a5-abd72c441878 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459255 Jul 16 12:41:22.021809 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:22.034262 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-3cb938fc-90d6-4271-a4e1-b40d7601ad0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:22.133945 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-3cb938fc-90d6-4271-a4e1-b40d7601ad0b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103421 Jul 16 12:41:22.134523 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Sat Jul 16 12:41:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:41:24.351738 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-dbae833e-ce38-4e59-88a5-abd72c441878 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:24.352836 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-dbae833e-ce38-4e59-88a5-abd72c441878 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 16 12:41:24.353360 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:24.722133 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-7003e6a5-80d0-4507-90ad-20f5d0b56308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "ram": 4096}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:24.816216 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-7003e6a5-80d0-4507-90ad-20f5d0b56308 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.456244 Jul 16 12:41:24.816796 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:24.829551 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c53f9072-ab96-41b1-a754-c2aec12120f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:24.934104 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c53f9072-ab96-41b1-a754-c2aec12120f5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108359 Jul 16 12:41:24.934694 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Sat Jul 16 12:41:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:27.252082 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-7003e6a5-80d0-4507-90ad-20f5d0b56308 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:27.253114 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-7003e6a5-80d0-4507-90ad-20f5d0b56308 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 16 12:41:27.253506 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:27.672754 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-36e4a98f-2c55-4b8b-9265-f1463eb4cde3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "id": "4", "name": "m1.large", "ram": 8192, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:27.744950 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-36e4a98f-2c55-4b8b-9265-f1463eb4cde3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.484810 Jul 16 12:41:27.746112 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:27.757922 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-4aa3da61-a438-4879-bc09-7c094080e1ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:27.834095 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-4aa3da61-a438-4879-bc09-7c094080e1ec admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079669 Jul 16 12:41:27.834923 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Sat Jul 16 12:41:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:41:30.044697 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-36e4a98f-2c55-4b8b-9265-f1463eb4cde3 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:30.045744 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-36e4a98f-2c55-4b8b-9265-f1463eb4cde3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 16 12:41:30.046181 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:30.481003 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-20fdea11-4f22-4313-8797-0e45bf24168f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:30.571867 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-20fdea11-4f22-4313-8797-0e45bf24168f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.519965 Jul 16 12:41:30.573255 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Sat Jul 16 12:41:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:30.585147 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-bd639727-7419-4c80-8fb2-82d952ef9f58 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:30.590165 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:41:30.689308 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-bd639727-7419-4c80-8fb2-82d952ef9f58 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107774 Jul 16 12:41:30.690351 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Sat Jul 16 12:41:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:41:50.922557 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-20fdea11-4f22-4313-8797-0e45bf24168f admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:50.923562 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-20fdea11-4f22-4313-8797-0e45bf24168f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 16 12:41:50.923958 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:51.310963 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-ba7528a6-2290-4738-be1a-32375f7e9964 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:51.328511 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-ba7528a6-2290-4738-be1a-32375f7e9964 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398535 Jul 16 12:41:51.329048 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Sat Jul 16 12:41:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:41:52.395759 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-20fdea11-4f22-4313-8797-0e45bf24168f admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:52.396760 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-20fdea11-4f22-4313-8797-0e45bf24168f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 16 12:41:52.397243 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:52.916940 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c1262bd7-4354-4c2a-8b41-2b7c5656fb62 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:52.922519 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.wsgi [None req-c1262bd7-4354-4c2a-8b41-2b7c5656fb62 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c1262bd7-4354-4c2a-8b41-2b7c5656fb62 admin admin] Request method failure captured: Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Accept: application/json Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Accept-Encoding: gzip, deflate Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Connection: keep-alive Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Content-Length: 0 Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Host: 10.222.0.47 Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Openstack-Api-Version: compute 2.90 Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Openstack-System-Scope: None Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: User-Agent: python-novaclient Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Auth-Token: gAAAAABi0rIQx1H8eW9AFBJYpjYXzDGZvp7VaHIRhOzVLmQmLGOv-TTV99tVcwNoDEqJHDjoOFZRPEwzuLmA_dcDPw29MUW72jNkFqgUzs0gwaugMdJ8bNrWEtkDX5WTud4EjkJBJBZfnc3Extf6OiwWXwMpfmcC96ags2DcloSm0d7onWFJurw Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Domain-Id: None Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Domain-Name: None Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Identity-Status: Confirmed Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Is-Admin-Project: True Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Openstack-Nova-Api-Version: 2.90 Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Domain-Id: default Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Domain-Name: Default Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Name: admin Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Role: member,reader,admin Jul 16 12:41:52.925743 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Roles: member,reader,admin Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d986eebab5a45d29f4ae51c867a19af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant: admin Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant-Name: admin Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User: admin Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Domain-Id: default Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Domain-Name: Default Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Id: 29ed4c3c304b4678a24977fbdcf04135 Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Name: admin Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: method: > Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: exception: Flavor 42 could not be found. Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: action_args: {'id': '42'} Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:41:52.927381 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:52.929620 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:52.931646 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c1262bd7-4354-4c2a-8b41-2b7c5656fb62 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:41:52.933187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c1262bd7-4354-4c2a-8b41-2b7c5656fb62 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.389976 Jul 16 12:41:52.933187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Sat Jul 16 12:41:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 16 12:41:52.937800 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-e06bf162-1e9f-48a7-8493-5cd58f436353 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:52.940780 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:41:52.959275 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-e06bf162-1e9f-48a7-8493-5cd58f436353 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025100 Jul 16 12:41:52.959819 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Sat Jul 16 12:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:41:52.970091 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-e02ad26c-a4e5-4ee8-8ffb-8cc629248307 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:52.991490 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-e02ad26c-a4e5-4ee8-8ffb-8cc629248307 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025060 Jul 16 12:41:52.992016 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Sat Jul 16 12:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:41:53.002230 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-9435f846-376d-4d83-8c83-0dd8f14dbcf1 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:53.008237 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.wsgi [None req-9435f846-376d-4d83-8c83-0dd8f14dbcf1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-9435f846-376d-4d83-8c83-0dd8f14dbcf1 admin admin] Request method failure captured: Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Accept: application/json Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Accept-Encoding: gzip, deflate Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Connection: keep-alive Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Content-Length: 0 Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Host: 10.222.0.47 Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Openstack-Api-Version: compute 2.90 Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Openstack-System-Scope: None Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: User-Agent: python-novaclient Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Auth-Token: gAAAAABi0rIQx1H8eW9AFBJYpjYXzDGZvp7VaHIRhOzVLmQmLGOv-TTV99tVcwNoDEqJHDjoOFZRPEwzuLmA_dcDPw29MUW72jNkFqgUzs0gwaugMdJ8bNrWEtkDX5WTud4EjkJBJBZfnc3Extf6OiwWXwMpfmcC96ags2DcloSm0d7onWFJurw Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Domain-Id: None Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Domain-Name: None Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Identity-Status: Confirmed Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Is-Admin-Project: True Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Openstack-Nova-Api-Version: 2.90 Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Domain-Id: default Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Domain-Name: Default Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Name: admin Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Role: member,reader,admin Jul 16 12:41:53.011783 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Roles: member,reader,admin Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d986eebab5a45d29f4ae51c867a19af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant: admin Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant-Name: admin Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User: admin Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Domain-Id: default Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Domain-Name: Default Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Id: 29ed4c3c304b4678a24977fbdcf04135 Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Name: admin Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: method: > Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: exception: Flavor 42 could not be found. Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: action_args: {'id': '42'} Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:41:53.017337 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:53.018334 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:53.019713 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-9435f846-376d-4d83-8c83-0dd8f14dbcf1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:41:53.021082 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-9435f846-376d-4d83-8c83-0dd8f14dbcf1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014468 Jul 16 12:41:53.021082 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Sat Jul 16 12:41:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 16 12:41:53.982011 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-e02ad26c-a4e5-4ee8-8ffb-8cc629248307 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:53.983007 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-e02ad26c-a4e5-4ee8-8ffb-8cc629248307 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 16 12:41:53.983396 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:54.531350 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-941ea5ce-8ed4-4e9f-8f30-06e154a7a90f admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:54.536563 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.wsgi [None req-941ea5ce-8ed4-4e9f-8f30-06e154a7a90f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-941ea5ce-8ed4-4e9f-8f30-06e154a7a90f admin admin] Request method failure captured: Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Accept: application/json Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Accept-Encoding: gzip, deflate Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Connection: keep-alive Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Content-Length: 0 Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Host: 10.222.0.47 Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Openstack-Api-Version: compute 2.90 Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Openstack-System-Scope: None Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: User-Agent: python-novaclient Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Auth-Token: gAAAAABi0rIRGC-Ufg3jPi3BlnwKzpOJPZ1ULA8_BVVM8D4L386TsxyK1tOxxUDtt32cKOKyUM7M_KyDvdUDLvnNDHmP1UAjnu0OPDW3zFG_f9maRzrvHbVtruUEULFW2X2zwfeH-ecyH7Kl6gyhZJFwgHBifVVpNHVMhye4m7SyMoCFxQF35do Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Domain-Id: None Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Domain-Name: None Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Identity-Status: Confirmed Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Is-Admin-Project: True Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Openstack-Nova-Api-Version: 2.90 Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Domain-Id: default Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Domain-Name: Default Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Name: admin Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Role: member,reader,admin Jul 16 12:41:54.538074 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Roles: member,reader,admin Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d986eebab5a45d29f4ae51c867a19af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant: admin Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant-Name: admin Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User: admin Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Domain-Id: default Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Domain-Name: Default Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Id: 29ed4c3c304b4678a24977fbdcf04135 Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Name: admin Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: method: > Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: exception: Flavor 84 could not be found. Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: action_args: {'id': '84'} Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:41:54.539615 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:54.540649 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.541896 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-941ea5ce-8ed4-4e9f-8f30-06e154a7a90f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:41:54.543124 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-941ea5ce-8ed4-4e9f-8f30-06e154a7a90f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.414984 Jul 16 12:41:54.543124 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Sat Jul 16 12:41:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 16 12:41:54.549535 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-f7c67b5d-9c37-4770-9426-966119934c2b admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:54.562986 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-f7c67b5d-9c37-4770-9426-966119934c2b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017319 Jul 16 12:41:54.563515 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Sat Jul 16 12:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:41:54.573266 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-8a22101c-e9f0-4622-b6f0-c6b9f239d691 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:54.586839 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-8a22101c-e9f0-4622-b6f0-c6b9f239d691 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Jul 16 12:41:54.588000 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Sat Jul 16 12:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:41:54.597273 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-e55ebdd1-4c53-4d81-ae63-265754f0b024 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:54.603062 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.wsgi [None req-e55ebdd1-4c53-4d81-ae63-265754f0b024 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-e55ebdd1-4c53-4d81-ae63-265754f0b024 admin admin] Request method failure captured: Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Accept: application/json Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Accept-Encoding: gzip, deflate Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Connection: keep-alive Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Content-Length: 0 Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Host: 10.222.0.47 Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Openstack-Api-Version: compute 2.90 Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Openstack-System-Scope: None Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: User-Agent: python-novaclient Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Auth-Token: gAAAAABi0rIRGC-Ufg3jPi3BlnwKzpOJPZ1ULA8_BVVM8D4L386TsxyK1tOxxUDtt32cKOKyUM7M_KyDvdUDLvnNDHmP1UAjnu0OPDW3zFG_f9maRzrvHbVtruUEULFW2X2zwfeH-ecyH7Kl6gyhZJFwgHBifVVpNHVMhye4m7SyMoCFxQF35do Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Domain-Id: None Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Domain-Name: None Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Identity-Status: Confirmed Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Is-Admin-Project: True Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Openstack-Nova-Api-Version: 2.90 Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Domain-Id: default Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Domain-Name: Default Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Name: admin Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Role: member,reader,admin Jul 16 12:41:54.604731 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Roles: member,reader,admin Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d986eebab5a45d29f4ae51c867a19af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant: admin Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant-Name: admin Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User: admin Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Domain-Id: default Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Domain-Name: Default Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Id: 29ed4c3c304b4678a24977fbdcf04135 Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Name: admin Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: method: > Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: exception: Flavor 84 could not be found. Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: action_args: {'id': '84'} Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:41:54.606296 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:54.607241 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:54.608691 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-e55ebdd1-4c53-4d81-ae63-265754f0b024 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:41:54.609933 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-e55ebdd1-4c53-4d81-ae63-265754f0b024 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012419 Jul 16 12:41:54.609933 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Sat Jul 16 12:41:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 16 12:41:55.636777 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-8a22101c-e9f0-4622-b6f0-c6b9f239d691 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:55.637830 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-8a22101c-e9f0-4622-b6f0-c6b9f239d691 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 16 12:41:55.638224 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:56.160065 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-26c3f64c-9898-4e46-baca-e8871e6c7f35 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:56.166124 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.wsgi [None req-26c3f64c-9898-4e46-baca-e8871e6c7f35 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-26c3f64c-9898-4e46-baca-e8871e6c7f35 admin admin] Request method failure captured: Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Accept: application/json Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Accept-Encoding: gzip, deflate Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Connection: keep-alive Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Content-Length: 0 Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Host: 10.222.0.47 Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Openstack-Api-Version: compute 2.90 Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Openstack-System-Scope: None Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: User-Agent: python-novaclient Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Auth-Token: gAAAAABi0rIT4zLTqseSnd7VJFpT3XVH2cWXRDJKV408vrwVxdmmm3XInWGfSKSERbQvECmESrtZ3DD5wffwmCDSIgO2CH-Fi-iovaPU62GpomH1n5hKF-YeeUGgd8U0iXNsiV3XF177kaZuXj1kBybFVtTk4YDiLoohxW_tLR2fVbypjNghzxo Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Domain-Id: None Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Domain-Name: None Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Identity-Status: Confirmed Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Is-Admin-Project: True Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Openstack-Nova-Api-Version: 2.90 Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Domain-Id: default Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Domain-Name: Default Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Project-Name: admin Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Role: member,reader,admin Jul 16 12:41:56.167594 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Roles: member,reader,admin Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d986eebab5a45d29f4ae51c867a19af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant: admin Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-Tenant-Name: admin Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User: admin Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Domain-Id: default Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Domain-Name: Default Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Id: 29ed4c3c304b4678a24977fbdcf04135 Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: X-User-Name: admin Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: method: > Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: exception: Flavor 451 could not be found. Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: action_args: {'id': '451'} Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:41:56.169187 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:56.170070 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.171243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-26c3f64c-9898-4e46-baca-e8871e6c7f35 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:41:56.172524 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-26c3f64c-9898-4e46-baca-e8871e6c7f35 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389758 Jul 16 12:41:56.172524 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Sat Jul 16 12:41:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 16 12:41:56.178765 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-191a84a3-066e-4213-af0d-ae53ded2a671 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:56.193013 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-191a84a3-066e-4213-af0d-ae53ded2a671 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017835 Jul 16 12:41:56.193570 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Sat Jul 16 12:41:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:41:56.203750 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:56.218519 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018208 Jul 16 12:41:56.219030 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Sat Jul 16 12:41:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:41:56.228115 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-dd3c73b4-3f2c-4172-8839-b72ec69916ad admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:56.233381 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.wsgi [None req-dd3c73b4-3f2c-4172-8839-b72ec69916ad admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-dd3c73b4-3f2c-4172-8839-b72ec69916ad admin admin] Request method failure captured: Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Accept: application/json Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Accept-Encoding: gzip, deflate Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Connection: keep-alive Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Content-Length: 0 Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Host: 10.222.0.47 Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Openstack-Api-Version: compute 2.90 Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Openstack-System-Scope: None Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: User-Agent: python-novaclient Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Auth-Token: gAAAAABi0rIT4zLTqseSnd7VJFpT3XVH2cWXRDJKV408vrwVxdmmm3XInWGfSKSERbQvECmESrtZ3DD5wffwmCDSIgO2CH-Fi-iovaPU62GpomH1n5hKF-YeeUGgd8U0iXNsiV3XF177kaZuXj1kBybFVtTk4YDiLoohxW_tLR2fVbypjNghzxo Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Domain-Id: None Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Domain-Name: None Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Identity-Status: Confirmed Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Is-Admin-Project: True Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Openstack-Nova-Api-Version: 2.90 Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Domain-Id: default Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Domain-Name: Default Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Project-Name: admin Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Role: member,reader,admin Jul 16 12:41:56.234855 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Roles: member,reader,admin Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d986eebab5a45d29f4ae51c867a19af", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d986eebab5a45d29f4ae51c867a19af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant: admin Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant-Id: 5d986eebab5a45d29f4ae51c867a19af Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-Tenant-Name: admin Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User: admin Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Domain-Id: default Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Domain-Name: Default Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Id: 29ed4c3c304b4678a24977fbdcf04135 Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: X-User-Name: admin Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: method: > Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: exception: Flavor 451 could not be found. Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: action_args: {'id': '451'} Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:41:56.236383 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:56.237399 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: ERROR nova.api.openstack.wsgi Jul 16 12:41:56.238768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-dd3c73b4-3f2c-4172-8839-b72ec69916ad admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110106) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:41:56.240003 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-dd3c73b4-3f2c-4172-8839-b72ec69916ad admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011700 Jul 16 12:41:56.240003 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Sat Jul 16 12:41:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 16 12:41:57.201551 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:57.202544 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 16 12:41:57.202926 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:57.720810 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-06e013cb-1647-4ca7-a6c7-a60062b50782 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:57.800129 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-06e013cb-1647-4ca7-a6c7-a60062b50782 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.458250 Jul 16 12:41:57.800664 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Sat Jul 16 12:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:41:58.777752 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:41:58.779330 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 16 12:41:58.779793 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:41:59.324537 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-6b00b52d-53c3-411b-a9e3-6ddab19690f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:41:59.408604 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-6b00b52d-53c3-411b-a9e3-6ddab19690f6 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.483372 Jul 16 12:41:59.409541 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Sat Jul 16 12:41:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:42:00.379020 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:00.380011 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 16 12:42:00.380426 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:42:00.977497 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-a924b44f-6c40-4d0d-ad0b-7175e4b28842 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:42:01.056168 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-a924b44f-6c40-4d0d-ad0b-7175e4b28842 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.535223 Jul 16 12:42:01.056720 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Sat Jul 16 12:42:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:42:02.040137 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:02.041125 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 16 12:42:02.041525 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:42:02.557768 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-c7a22b5b-631f-4a72-b8bc-1a1e1ffaade0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:42:02.652716 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-c7a22b5b-631f-4a72-b8bc-1a1e1ffaade0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.470835 Jul 16 12:42:02.653287 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Sat Jul 16 12:42:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:42:03.629802 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:03.630802 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 16 12:42:03.632558 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:42:04.153617 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-7cd7eac8-77d8-4734-9cc3-720007e5b4d3 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:04.172764 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-7cd7eac8-77d8-4734-9cc3-720007e5b4d3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403044 Jul 16 12:42:04.173523 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Sat Jul 16 12:42:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:42:55.386140 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:55.387140 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-c71b8a63-23c4-4cff-a4ee-6ed587f0a4f0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 16 12:42:55.387531 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Sat Jul 16 12:42:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:42:55.398027 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:42:55.793490 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-cf26560b-d90f-4439-8565-be1ac9680fe4 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:55.812672 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-cf26560b-d90f-4439-8565-be1ac9680fe4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419240 Jul 16 12:42:55.813317 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Sat Jul 16 12:42:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:42:55.837244 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-b942368e-839f-4a1f-b13b-22659cf65e0d admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:55.840612 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG dbcounter [-] [110105] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=110105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:42:55.845508 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-b942368e-839f-4a1f-b13b-22659cf65e0d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012077 Jul 16 12:42:55.846024 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Sat Jul 16 12:42:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:42:55.858441 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-6940d8dd-76c6-4fe3-854e-f70dd933eddd admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:55.866806 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-6940d8dd-76c6-4fe3-854e-f70dd933eddd admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011985 Jul 16 12:42:55.867319 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Sat Jul 16 12:42:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:42:55.878941 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:55.887039 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011962 Jul 16 12:42:55.887552 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Sat Jul 16 12:42:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:42:55.899093 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-61be81b6-aa77-4afb-bfaa-4c07287edd8d admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:42:55.907026 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-61be81b6-aa77-4afb-bfaa-4c07287edd8d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011603 Jul 16 12:42:55.907534 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Sat Jul 16 12:42:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:46:46.281883 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:46.282887 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 16 12:46:46.283272 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:46:46.431893 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_api:SELECT=6 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:46:46.570911 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-a378c5b4-0657-405b-8b62-ba3c4833b816 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:46.572103 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:46:46.572103 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: warnings.warn(msg) Jul 16 12:46:46.573438 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-a378c5b4-0657-405b-8b62-ba3c4833b816 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:46:46.573872 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-a378c5b4-0657-405b-8b62-ba3c4833b816 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:46:46.574652 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-a378c5b4-0657-405b-8b62-ba3c4833b816 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:46:46.575078 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-a378c5b4-0657-405b-8b62-ba3c4833b816 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:46:46.609215 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-a378c5b4-0657-405b-8b62-ba3c4833b816 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.178660 Jul 16 12:46:46.609763 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Sat Jul 16 12:46:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:46:47.442542 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:47.443574 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 16 12:46:47.443965 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:46:47.634899 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-2cc5cb94-3158-4eb7-9c5a-7073dc768010 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:47.636067 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:46:47.636067 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: warnings.warn(msg) Jul 16 12:46:47.637423 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-2cc5cb94-3158-4eb7-9c5a-7073dc768010 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:46:47.637862 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-2cc5cb94-3158-4eb7-9c5a-7073dc768010 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:46:47.638650 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-2cc5cb94-3158-4eb7-9c5a-7073dc768010 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:46:47.639081 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-2cc5cb94-3158-4eb7-9c5a-7073dc768010 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:46:47.658208 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-2cc5cb94-3158-4eb7-9c5a-7073dc768010 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075246 Jul 16 12:46:47.658680 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Sat Jul 16 12:46:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:46:58.895761 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:58.896749 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 16 12:46:58.897153 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:46:59.042269 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_cell0:SELECT=4 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:46:59.042985 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_cell1:SELECT=4 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:46:59.043599 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG dbcounter [-] [110106] Writing DB stats nova_api:SELECT=8 {{(pid=110106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:46:59.093167 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-0f1a6515-470d-45eb-b089-793562a9ef21 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:59.093167 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:46:59.093167 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: warnings.warn(msg) Jul 16 12:46:59.094114 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-0f1a6515-470d-45eb-b089-793562a9ef21 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:46:59.094551 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-0f1a6515-470d-45eb-b089-793562a9ef21 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:46:59.095329 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-0f1a6515-470d-45eb-b089-793562a9ef21 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:46:59.095755 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-0f1a6515-470d-45eb-b089-793562a9ef21 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:46:59.121162 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-0f1a6515-470d-45eb-b089-793562a9ef21 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083189 Jul 16 12:46:59.121880 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Sat Jul 16 12:46:59 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:46:59.946249 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: DEBUG nova.api.openstack.wsgi [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] Calling method '>' {{(pid=110105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:46:59.947243 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: INFO nova.api.openstack.requestlog [None req-cec2000f-f4c3-4e73-9888-6a422586082f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jul 16 12:46:59.947636 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: [pid: 110105|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Sat Jul 16 12:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:47:00.140172 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG nova.api.openstack.wsgi [None req-d5ed95ef-35d6-400c-8cff-05692288d493 admin admin] Calling method '>' {{(pid=110106) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:47:00.141395 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 16 12:47:00.141395 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: warnings.warn(msg) Jul 16 12:47:00.142591 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-d5ed95ef-35d6-400c-8cff-05692288d493 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:47:00.143029 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-d5ed95ef-35d6-400c-8cff-05692288d493 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:47:00.144426 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-d5ed95ef-35d6-400c-8cff-05692288d493 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:47:00.144873 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: DEBUG oslo_concurrency.lockutils [None req-d5ed95ef-35d6-400c-8cff-05692288d493 admin admin] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110106) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:47:00.167156 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: INFO nova.api.openstack.requestlog [None req-d5ed95ef-35d6-400c-8cff-05692288d493 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078284 Jul 16 12:47:00.167629 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: [pid: 110106|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Sat Jul 16 12:47:00 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:47:56.003051 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: Sat Jul 16 12:47:56 2022 - graceful shutdown triggered... Jul 16 12:47:56.003552 dv-cinder-836973-12-iscsi devstack@n-api.service[110105]: Gracefully killing worker 1 (pid: 110105)... Jul 16 12:47:56.006010 dv-cinder-836973-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 16 12:47:56.006613 dv-cinder-836973-12-iscsi devstack@n-api.service[110106]: Gracefully killing worker 2 (pid: 110106)... Jul 16 12:47:57.004200 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: worker 1 buried after 2 seconds Jul 16 12:47:57.005416 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: worker 2 buried after 2 seconds Jul 16 12:47:57.005416 dv-cinder-836973-12-iscsi devstack@n-api.service[110104]: goodbye to uWSGI. Jul 16 12:47:57.006381 dv-cinder-836973-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 16 12:47:57.006934 dv-cinder-836973-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 16 12:47:57.009739 dv-cinder-836973-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 16 12:47:57.019307 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 16 12:47:57 2022] *** Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: nodename: dv-cinder-836973-12-iscsi Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: machine: x86_64 Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: clock source: unix Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: pcre jit disabled Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: detected number of CPU cores: 4 Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: current working directory: / Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: detected binary path: /usr/bin/uwsgi-core Jul 16 12:47:57.021390 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: your processes number limit is 47680 Jul 16 12:47:57.022150 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: your memory page size is 4096 bytes Jul 16 12:47:57.022150 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: detected max file descriptor number: 2048 Jul 16 12:47:57.022150 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: lock engine: pthread robust mutexes Jul 16 12:47:57.022150 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: thunder lock: enabled Jul 16 12:47:57.022150 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 16 12:47:57.022150 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 16 12:47:57.062751 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: Python main interpreter initialized at 0x556619bd99c0 Jul 16 12:47:57.062751 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: python threads support enabled Jul 16 12:47:57.062751 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: your server socket listen backlog is limited to 100 connections Jul 16 12:47:57.062751 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: your mercy for graceful operations on workers is 90 seconds Jul 16 12:47:57.063224 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: mapped 403077 bytes (393 KB) for 2 cores Jul 16 12:47:57.063224 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: *** Operational MODE: preforking *** Jul 16 12:47:57.063481 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: *** uWSGI is running in multiple interpreter mode *** Jul 16 12:47:57.063481 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: spawned uWSGI master process (pid: 124632) Jul 16 12:47:57.066145 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: spawned uWSGI worker 1 (pid: 124651, cores: 1) Jul 16 12:47:57.066145 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: spawned uWSGI worker 2 (pid: 124652, cores: 1) Jul 16 12:47:57.066145 dv-cinder-836973-12-iscsi devstack@n-api.service[124632]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 16 12:47:57.063685 dv-cinder-836973-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 16 12:47:57.735705 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 16 12:47:57.741463 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 16 12:47:58.916933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:47:58.916933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: from cryptography.utils import int_from_bytes Jul 16 12:47:58.917645 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:47:58.917645 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: from cryptography.utils import int_from_bytes Jul 16 12:47:58.930915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:47:58.930915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: from cryptography.utils import int_from_bytes Jul 16 12:47:58.931411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 16 12:47:58.931411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: from cryptography.utils import int_from_bytes Jul 16 12:48:01.237078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 12:48:01.237928 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 12:48:01.238832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 12:48:01.239420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 12:48:01.239853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 12:48:01.240410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.240908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.241419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.241915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.242415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.242892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.243370 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.243862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.244363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.244793 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.245308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.245850 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-12-iscsi {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.246333 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.246819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.247287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.247777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.248248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.248739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.249251 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.250042 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.250823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.251293 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.251764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 16 12:48:01.252186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.252186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.252498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.252712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 16 12:48:01.252828 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.253081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.253207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 16 12:48:01.253405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.253597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 16 12:48:01.253729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.253813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 16 12:48:01.254121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.254237 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.254529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.254736 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-12-iscsi {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.254856 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.255038 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.255145 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.255333 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.255462 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.255660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.255780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.256071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.256204 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.256425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.256680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.256805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.257019 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.257323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.257563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.257783 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.258017 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.258237 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.258459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836973-12-iscsi {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.258682 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.258903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.259128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.259313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.259461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.259648 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.259800 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.259985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.260143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.260295 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.260447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.260634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.260802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.260955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.261151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.261151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.261448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.261625 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.261814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262201 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262358 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262511 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262840 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.262999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.263153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.263308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.263466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.263618 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.263775 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.263932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.264089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.264265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.264418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.264574 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.264736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.265449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.265607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836973-12-iscsi {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.265766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.265920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.266081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.266226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.266381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.266621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.266785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.266785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.267088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.267255 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.267402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.267553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.267706 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.267932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.268088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.268233 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.268377 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.268568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.268725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.268884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.269028 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.269206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.269351 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.269351 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.270145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.270145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.270465 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.270612 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.270811 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.270811 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.271149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.271309 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.271456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.271609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.271766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.271921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272646 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.272972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.273228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.273406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.273561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.273715 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.273879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274043 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274491 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274491 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.274955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.275671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.275833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.275979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.276144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.276323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.276476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.276651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.276867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.277026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.277250 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.277406 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.277560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.277716 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.277873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278028 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278503 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.278943 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.279097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.279252 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.279408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.279552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.279697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.279846 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.280909 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281546 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.281994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.282157 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.282312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.282457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.282608 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.282939 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283414 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283558 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.283996 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.284150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.284306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.284306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.284579 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.284724 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.284873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.285032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.286426 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.286597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.286756 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.286994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.287154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.287318 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.287475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.287633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.287776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.287920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288083 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288677 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288833 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.288987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.289157 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.289302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.289447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.289615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.289762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.289919 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290224 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290375 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.290963 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.291114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.291265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.291418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.291581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.291735 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.291881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.292024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.292177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.292330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.292489 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.292642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.292642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.292944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.293135 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.293287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.293443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.293595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.293747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.293906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.294061 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.294213 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.294366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.294521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.294678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.294832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.294986 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.295138 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.295291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.295474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.295772 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.295941 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.296114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.296733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.296888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.297482 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.297653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.297802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.297947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.298099 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.298255 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.298411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.298569 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.298569 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.298855 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.299008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.299160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.299320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.299603 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.299759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.299905 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.300056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.300209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.300354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.300517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.300662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.300813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.301004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.301241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.301411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.301557 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.301702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.301846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.302000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.302146 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.302304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 16 12:48:01.302461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.302626 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.302788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.302947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303105 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303251 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303843 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.303987 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.304142 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.304302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.304464 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.304618 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.304762 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.304911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.305113 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.305285 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.305432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.305576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.305884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.306043 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.306201 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.306815 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.306979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.307164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.307382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.307540 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.307695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.307852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308006 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308610 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308755 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.308907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309240 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.309993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.310145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.310557 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.310713 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.310858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311283 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311601 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311754 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.311906 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312051 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312354 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312653 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.312955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.313164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.313337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.313503 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.313788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.313962 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.314128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.314283 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.314439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.314597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.314751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.314904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.315049 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.315204 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.315350 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.315512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.315660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.315812 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.316133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.316301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.316466 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.317357 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.317580 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.317733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.317879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318037 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318199 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318352 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318828 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.318973 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319118 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319261 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319715 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.319862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.320159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.320312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.320467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.320626 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.320779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.320925 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.321118 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.321896 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.322063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.322227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.322380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.322534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.322696 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.322844 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.323028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.323312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.323473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.323627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.323773 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.323918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324233 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324842 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.324997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.325190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.325345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.325497 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.325642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.325793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.325953 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.326231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.326390 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.326536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.326699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.327264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.327561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.327790 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.330575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.330741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.330894 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.331059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.331216 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.331373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.331519 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.331671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.331818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.332046 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.332739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.332900 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.333074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.333277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.333510 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.333672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.333827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.333980 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.334133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.334287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.334441 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.334594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.334752 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.334911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.335070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.335241 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.335407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.335566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.335717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.335874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.336025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.336202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.336444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.336604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.336755 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.337206 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.337469 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.337754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.338800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.339109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.339271 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.339431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.339590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.339758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.339918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.340088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.340240 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.340400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.340552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.340716 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.340867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.341026 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.341245 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.341396 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.341594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.341762 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.341916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.342074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.342257 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.342413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.342564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.342724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.342877 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.343027 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.343188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.343340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.343523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.343762 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.343923 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.344083 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.344241 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.344406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.344571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.344731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.344882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345051 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345678 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345831 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.345966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346356 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346465 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346743 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.346928 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.347356 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.347471 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.347932 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348233 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348314 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348389 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348812 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.348969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349185 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349372 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349465 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349834 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.349929 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350112 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350401 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350669 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350763 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.350950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351129 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351224 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351515 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351601 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351875 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.351971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352059 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352145 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352416 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352504 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352684 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.352962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353471 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.353938 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354496 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.354689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.355736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356203 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.356921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.357852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.358524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.358621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.358621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.358621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.358621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.358969 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359233 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359652 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.359948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.360265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.360366 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.360597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.360859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.360954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.361289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.361487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.361595 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.361894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.362096 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.362190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.362490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.362802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.363044 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.363140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.363911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.364174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.364308 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.364526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.364831 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.364933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.365164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.365469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.365565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.365773 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.366073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.366170 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.366376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.366673 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.366783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.366976 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.367561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.367681 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.367779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.367867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.367963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.368270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.368478 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.368573 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.368816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.369079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.369191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.369487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.369696 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.369805 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.370147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.370249 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.370455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.370761 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.370854 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.371085 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.371385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.371479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.371687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.371967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.372063 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.372289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.372568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.372662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.372909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.373200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.373333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.373525 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.373798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.373895 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.374133 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.374793 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.374919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375328 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.375943 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.376084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.376248 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.376559 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.376660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.376867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.377191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.377318 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.377824 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.377915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.378010 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.378111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.378406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.378515 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.378680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.378950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.379624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.379871 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.380225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.380319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.380577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.380826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.380930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.381235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.381433 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.381537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.381839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.382018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.382150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.382454 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.382645 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.382747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.383057 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.383252 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.383398 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.383684 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.383874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.383971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.384283 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.384481 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.384577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.384879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.385123 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.385236 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.385505 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.385712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.385807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.386096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.386299 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.386393 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.386688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.386894 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.386998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.387298 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.387843 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.387963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.388055 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.388152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.388249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.388541 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.388657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.388807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.389134 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.389242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.389495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.389729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.389831 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.390109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.390312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.390429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.390740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.390919 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.391050 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.391361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.391506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.391663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.391979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.392080 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.392288 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.392591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.392765 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.392893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.393200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.393313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.393532 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.393813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.393929 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.394144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.394405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.394500 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.394904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.395021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.395381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.395569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.395693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.396008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.396159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.396325 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.396637 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.396730 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.397385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.397485 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.397987 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.397987 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.398273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.398385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.398385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.398560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.398664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.399080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.399202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.399309 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.399489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.399697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.399794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.400089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.400290 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.400402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.400717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.400881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.401382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.401508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.401680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.401680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.401945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.402047 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.402250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.402611 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.402722 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.402995 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.403207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.403303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.403600 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.403832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.403950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.404210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.404408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.404512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.404830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.405001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.405176 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.405529 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.405624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.405898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.406114 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.406225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.406510 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.406723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.406826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.407107 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.407308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.407412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.407776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.408280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.408383 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.408473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.408560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.408662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.408910 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.409005 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.409238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.409636 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.409745 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.410082 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.410174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.410361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.410698 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.410814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.411113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.411372 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.411475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.411898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412016 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412115 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412435 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412657 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.412954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.413286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.413398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.413599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.413815 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.413970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.414205 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.414329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.414527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.414642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.414839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.414944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.415144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.415259 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.415465 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.415571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.415785 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.415896 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.416098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.416213 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.416414 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.416517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.416776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.416888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.417118 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.417242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.417455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.417559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.417777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.417868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.418252 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.418432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.418597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.418756 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.418899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.419041 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.419192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.419356 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.419494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.419646 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.419890 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420044 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420346 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420786 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.420935 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421252 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421395 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.421981 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.422122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.422263 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.422420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.422563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.422720 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.422861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423451 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423749 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.423898 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424665 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424807 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.424951 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.425154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.425250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.425250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.425425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.425588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.425686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.426399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.426521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.426722 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.426854 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.427053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.427164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.427382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.427479 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.427692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.427788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428027 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428474 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428658 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.428963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.429112 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.429313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.429417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.429619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.429713 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.429927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430649 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.430989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.431160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.431311 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.431473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.431717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.431830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432185 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432669 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.432975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.433105 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.433321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.433421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.433634 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.433756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.433938 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.434055 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.434242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.434371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435912 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.435994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.436167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.436499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.436809 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.437149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.437372 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.437490 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.437771 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.437874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.438116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.438224 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.438540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.438803 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.439026 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.439135 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.439374 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.439479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.439826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.439942 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.440293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.440401 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.440644 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.440782 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.440984 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.441164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.441348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.441570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.442326 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.442538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.442654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.442964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.443060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.443288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.443392 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.443621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.443726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.443946 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.444049 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.444282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.444617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.444719 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.444941 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.445086 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.445291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.445387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.445607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.445709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.445939 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.446036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.446269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.446375 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.446590 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.446695 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.446917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.447020 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.447240 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.447334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.447563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.447672 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.447914 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.448025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.448275 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.448390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.448629 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.448748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.448914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.449104 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.449248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.449455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.449561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.449785 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.449901 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.450111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.450208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.450474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.450577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.450785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.450881 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.451103 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.451229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.451419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.451559 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.451731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.451877 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452038 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452200 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452346 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452673 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.452978 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.453225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.453341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.453546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.453656 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.453899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454222 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454856 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.454950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.455167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.455270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.455473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.455568 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.455779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.455874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.456085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.456189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.456428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.456531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.456735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.456830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.457172 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.457289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.457514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.457709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.458045 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.458151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.458360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.458472 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.458699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.458816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.459034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.459235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.459359 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.459457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.459678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.459779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460391 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460505 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460711 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.460926 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461031 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461270 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461368 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461579 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461889 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.461990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.462218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.462315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.462536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.462631 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.462847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.462952 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.463149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.463249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.463471 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.463567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.463777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464388 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464491 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464692 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.464999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.465208 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.465351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.465454 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.465679 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.465781 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.465988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.466088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.466315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.466417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.466627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.466724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.466939 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467035 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.467979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.468188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.468285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.468503 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.468616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.468819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.468933 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.469151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.469271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.469466 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.469567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.469773 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.469867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.470093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.470195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.470404 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.470514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.470715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.470819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471027 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471437 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.471994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.472230 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.472333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.472548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.472643 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.472977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.473124 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.473323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.473470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.473639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.473726 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474364 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474600 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474600 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.474994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.475158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.475242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.475489 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.475588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.475813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.475919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.476124 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.476219 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.476449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.476554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.476768 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.476869 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.477104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.477204 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.477423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.477530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.477739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.477842 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.478092 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.478196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.478405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.478522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.478714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.478957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.479052 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.479294 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.479399 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.479598 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.479695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.479934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480042 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480342 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480860 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.480971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.481196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.481292 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.481596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.481700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.481811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.481907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.482126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.482224 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.482445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.482550 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.482763 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.482859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.483080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.483314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.483438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.483535 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.483698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.483793 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484012 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484533 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484638 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.484963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.485211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.485334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.485538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.485635 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.485864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.485968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.486183 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.486291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.486505 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.486607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.486830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.486925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.487135 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.487228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.487439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.487536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.487749 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.487852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.488060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.488165 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.488888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.489003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.489232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.489479 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.489640 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.489746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.489992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.490090 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.490317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.490422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.490632 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.490726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.491062 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.491163 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.491383 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.491492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.491710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.491814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.492064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.492160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.492381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.492488 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.492709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.492807 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493369 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493677 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493778 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.493984 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.494079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.494302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.494399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.494616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.494721 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.494922 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495028 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495233 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495356 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495858 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.495954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.496163 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.496259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.496474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.496570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.496779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.496882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.497118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.497216 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.497429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.497535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.497733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.497836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498647 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498755 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.498952 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499044 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499256 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499349 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.499963 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.500169 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.500293 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.500475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.500609 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.500783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.500915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.501117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.501251 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.501429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.501559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.501744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.501871 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.502978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.503159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.503355 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.503478 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.503613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.503777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.503951 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.504150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.504951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.505072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.505291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.505553 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.505657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.505878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.505982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.506207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.506467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.506574 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.506804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.506908 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.507128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.507223 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.507460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.507555 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.507777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.507882 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.508085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.508179 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.508394 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.508498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.508701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.508808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509183 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509362 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509471 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.509977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.510071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.510296 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.510393 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.510634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.510734 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.510950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511055 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511573 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511670 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.511983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.512191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.512296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.512500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.512595 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.512810 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.512907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.513144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521215 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521324 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521644 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521720 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.521964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522046 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522224 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522396 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522576 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522762 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522762 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522896 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.522989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523262 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523357 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523532 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523716 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523903 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.523998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524094 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.524992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525119 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124651) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.525876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.526486 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.526486 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.526486 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.526486 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.526486 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.526906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.527022 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.527327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.527633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.527938 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.528248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.528553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.528856 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.529179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.529487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.529847 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.530179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.530514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.530831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.531155 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.531467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.531788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.532097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.532421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.532744 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.533085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.533401 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.533738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.534051 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.534364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.534677 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.534990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.535824 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.536205 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.536591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.536935 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.537263 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.537594 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.537916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.538243 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.538561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.538873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.539204 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.539518 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.539831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.540162 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.540457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.540775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.541114 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.541431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.541746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.542065 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.542382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.542714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.543106 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.543420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.543750 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.544079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.544438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.544756 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.545128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.546840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.546840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.546840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.546840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 16 12:48:01.546840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124652) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 16 12:48:01.673947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO dbcounter [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Registered counter for database nova_api Jul 16 12:48:01.694978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_db.sqlalchemy.engines [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.701620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writer thread running {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.702770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO dbcounter [None req-8345fc18-a264-4859-884d-54630d97518d None None] Registered counter for database nova_api Jul 16 12:48:01.723309 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_db.sqlalchemy.engines [None req-8345fc18-a264-4859-884d-54630d97518d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.730070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writer thread running {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.760229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.context [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7da9c633-d1e3-4a76-a464-f6bb00d1ecba(cell1) {{(pid=124651) load_cells /opt/stack/nova/nova/context.py:464}} Jul 16 12:48:01.764227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:48:01.765853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:48:01.766651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:48:01.768650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:48:01.771301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO dbcounter [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Registered counter for database nova_cell0 Jul 16 12:48:01.775345 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO dbcounter [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Registered counter for database nova_cell1 Jul 16 12:48:01.782783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_db.sqlalchemy.engines [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.784208 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_db.sqlalchemy.engines [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.790104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.context [None req-8345fc18-a264-4859-884d-54630d97518d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7da9c633-d1e3-4a76-a464-f6bb00d1ecba(cell1) {{(pid=124652) load_cells /opt/stack/nova/nova/context.py:464}} Jul 16 12:48:01.791114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writer thread running {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.792587 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writer thread running {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.794133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8345fc18-a264-4859-884d-54630d97518d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:48:01.795698 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8345fc18-a264-4859-884d-54630d97518d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:48:01.796488 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8345fc18-a264-4859-884d-54630d97518d None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:48:01.798492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8345fc18-a264-4859-884d-54630d97518d None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:48:01.800564 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO dbcounter [None req-8345fc18-a264-4859-884d-54630d97518d None None] Registered counter for database nova_cell0 Jul 16 12:48:01.804750 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO dbcounter [None req-8345fc18-a264-4859-884d-54630d97518d None None] Registered counter for database nova_cell1 Jul 16 12:48:01.812312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_db.sqlalchemy.engines [None req-8345fc18-a264-4859-884d-54630d97518d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.817995 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writer thread running {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.818616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_db.sqlalchemy.engines [None req-8345fc18-a264-4859-884d-54630d97518d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.941077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO dbcounter [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Registered counter for database nova_cell0 Jul 16 12:48:01.948794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_db.sqlalchemy.engines [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124651) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.953121 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writer thread running {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.961757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writer thread running {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:01.970927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO dbcounter [None req-8345fc18-a264-4859-884d-54630d97518d None None] Registered counter for database nova_cell0 Jul 16 12:48:01.978439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_db.sqlalchemy.engines [None req-8345fc18-a264-4859-884d-54630d97518d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124652) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 16 12:48:01.982997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writer thread running {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 16 12:48:02.274752 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: WARNING keystonemiddleware.auth_token [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:48:02.282014 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: WARNING keystonemiddleware.auth_token [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:48:02.313196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: WARNING keystonemiddleware.auth_token [None req-8345fc18-a264-4859-884d-54630d97518d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:48:02.321934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: WARNING keystonemiddleware.auth_token [None req-8345fc18-a264-4859-884d-54630d97518d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:48:02.631603 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: WARNING keystonemiddleware.auth_token [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:48:02.637586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: WARNING keystonemiddleware.auth_token [None req-34851f0e-5a3c-431a-95c6-d1542b82ac62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:48:02.642891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556619bd99c0 pid: 124651 (default app) Jul 16 12:48:02.671020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: WARNING keystonemiddleware.auth_token [None req-8345fc18-a264-4859-884d-54630d97518d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 16 12:48:02.677158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: WARNING keystonemiddleware.auth_token [None req-8345fc18-a264-4859-884d-54630d97518d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 16 12:48:02.682498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556619bd99c0 pid: 124652 (default app) Jul 16 12:48:47.925533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:47.927998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:47.932624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:47.935472 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:48.239477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6d374d8d-ecaf-4707-98f3-a77970684e0d tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfada4310>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:48.696234 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6d374d8d-ecaf-4707-98f3-a77970684e0d tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ab29e9c9-51ca-4483-acc7-f7f7b9ed844a" status: 200 len: 349 microversion: 2.1 time: 0.783562 Jul 16 12:48:48.698446 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 1/1] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:48:47 2022] GET /compute/v2.1/os-volumes/ab29e9c9-51ca-4483-acc7-f7f7b9ed844a => generated 349 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:50.791791 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:50.794751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:50.799012 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:50.803418 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:48:51.274908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ba4b0885-89fd-455b-97f8-dc823995baee tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfada33a0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:52.270907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ba4b0885-89fd-455b-97f8-dc823995baee tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/55dc021a-e976-45ee-a505-11b23ff01a85" status: 200 len: 351 microversion: 2.1 time: 1.487415 Jul 16 12:48:52.271902 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 1/2] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:48:50 2022] GET /compute/v2.1/os-volumes/55dc021a-e976-45ee-a505-11b23ff01a85 => generated 351 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:54.271419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3601c2e2-b298-48c4-9222-46fef574ae58 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac6c940>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:54.438347 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3601c2e2-b298-48c4-9222-46fef574ae58 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e999d3ba-e50a-4a09-bae9-3f68cdee5867" status: 200 len: 351 microversion: 2.1 time: 0.171601 Jul 16 12:48:54.439816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:48:54 2022] GET /compute/v2.1/os-volumes/e999d3ba-e50a-4a09-bae9-3f68cdee5867 => generated 351 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:54.459831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5a77bb20-f31d-49d8-bb69-fe8d0213b8b2 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac683a0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:54.640031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5a77bb20-f31d-49d8-bb69-fe8d0213b8b2 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.184573 Jul 16 12:48:54.641056 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1133 bytes} [Sat Jul 16 12:48:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:48:54.653742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-72ca29ed-d5e5-456f-8c6f-1e47abb85d2b tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac6c4c0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:54.769977 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-72ca29ed-d5e5-456f-8c6f-1e47abb85d2b tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.120562 Jul 16 12:48:54.771003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1148 bytes} [Sat Jul 16 12:48:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:54.784547 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-eb617c94-e4f2-4199-b0ec-261872119268 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac251f0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:55.067339 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-eb617c94-e4f2-4199-b0ec-261872119268 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.286706 Jul 16 12:48:55.067492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1133 bytes} [Sat Jul 16 12:48:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:48:55.080543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4ef8a29a-3ade-43d1-a9cd-080f41ebb205 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac6cf70>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:55.247006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4ef8a29a-3ade-43d1-a9cd-080f41ebb205 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.170997 Jul 16 12:48:55.247756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1166 bytes} [Sat Jul 16 12:48:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:55.261261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1f8d8b52-d5e7-4f3c-b3c2-52116b48580d tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfb600820>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:55.415490 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1f8d8b52-d5e7-4f3c-b3c2-52116b48580d tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.159533 Jul 16 12:48:55.416244 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1169 bytes} [Sat Jul 16 12:48:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:55.434108 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6f723bba-9f82-4a11-a94e-664b017c801f tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac25280>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:55.633744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6f723bba-9f82-4a11-a94e-664b017c801f tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.208807 Jul 16 12:48:55.635946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 5/9] 10.222.0.47 () {58 vars in 1154 bytes} [Sat Jul 16 12:48:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:48:55.649087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5faebc39-505a-4897-b5e6-4443af63b0d6 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac25af0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:55.827436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5faebc39-505a-4897-b5e6-4443af63b0d6 tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183343 Jul 16 12:48:55.828325 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 5/10] 10.222.0.47 () {58 vars in 1187 bytes} [Sat Jul 16 12:48:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:48:55.840774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-519a10f0-ca3a-4c29-a33a-c4bb634baaeb tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] Calling method '.version_select at 0x7f6cfac25ee0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:48:56.017798 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-519a10f0-ca3a-4c29-a33a-c4bb634baaeb tempest-VolumesTestJSON-1812874134 tempest-VolumesTestJSON-1812874134-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.180276 Jul 16 12:48:56.018371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1154 bytes} [Sat Jul 16 12:48:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:48:59.560399 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-769c9a5e-ddd1-4768-9f8a-34779630c8a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'create', calling method: .version_select at 0x7f6cfac25dc0>, body: {"keypair": {"name": "tempest-keypair-1704046158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+AuwIOF/YTyvsG42uyuiab26XIo8T5fKRXsyGm/YkG8mbH67zbQCSB+HS4cI50yFUb8cg+LDWUQQhq0PIb8I1Fgz+hxNgJjfv8U5yZE6mIFGf8DFej656oCnQQ2e3SSQ=="}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:48:59.668906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-769c9a5e-ddd1-4768-9f8a-34779630c8a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for project f762c3c164904a3bb6e64985744c1765. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:48:59.694234 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-769c9a5e-ddd1-4768-9f8a-34779630c8a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for user 3e12d902f94b40cea088dc6f24dcb444 and project f762c3c164904a3bb6e64985744c1765. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:48:59.853491 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-769c9a5e-ddd1-4768-9f8a-34779630c8a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.597004 Jul 16 12:48:59.854262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 6/12] 10.222.0.47 () {62 vars in 1199 bytes} [Sat Jul 16 12:48:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 599 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 16 12:49:04.055845 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9e79d47d-6618-4c12-a56d-578f1a0a28cc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: .version_select at 0x7f6cfac254c0>, body: {"keypair": {"name": "tempest-keypair-1212866917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3qAnYmrj17I+MThbh9bG1DVeOrCqGlsuriqQAtUUrG4nrhRHKXP9xhyjDX7lw84fAJ/Z4Jrup3bCVv2fZaVjyi+kWz+t6EDDHz5tl6/vKyVZNgQtyeHAa/2OGb0AK/jQ=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:04.143128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-9e79d47d-6618-4c12-a56d-578f1a0a28cc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for project 858d6855277f465497c27313765e5d1a. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:04.164013 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-9e79d47d-6618-4c12-a56d-578f1a0a28cc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for user 46b5c80d8bf34965a30b9b67e9117996 and project 858d6855277f465497c27313765e5d1a. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:04.274822 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-548598847", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "networks": [{"uuid": "f93b30d3-81e6-482a-b04c-f58914972d06"}]}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:04.387982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9e79d47d-6618-4c12-a56d-578f1a0a28cc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.101909 Jul 16 12:49:04.396116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 7/13] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:49:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:04.508874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] validate_networks() for [('f93b30d3-81e6-482a-b04c-f58914972d06', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:49:04.595413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-76d4dff9-3fe9-4738-87ee-370037e38c32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: .version_select at 0x7f6cfab883a0>, body: {"keypair": {"name": "tempest-keypair-579021624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEAawRErGSKajci8HLSgkEuv4RfV/BY2VGKWrT+HriHWIZdKfLjXpjH18QedRWZiYp6rd68ryFDpmllhO+EraZbStdzwbz8AOcsSYao2Qwmyhzu1PwoseGHzycOI09Iuw=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:04.614375 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-76d4dff9-3fe9-4738-87ee-370037e38c32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:04.621277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-76d4dff9-3fe9-4738-87ee-370037e38c32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:04.710825 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-76d4dff9-3fe9-4738-87ee-370037e38c32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.267398 Jul 16 12:49:04.715009 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 8/14] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:49:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:49:05.455239 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-291098805", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:05.638913 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] validate_networks() for [('75d58424-1eb7-487d-b17b-bf9f6568128d', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:49:06.843524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:49:06.845013 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:49:06.845724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:49:06.846480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:49:06.848076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:49:06.870743 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:06.873790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:06.885640 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:06.885640 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:07.043724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Getting quotas for project 5a6b49c60dc845c5a74f3ab5d132740d. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:07.068482 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Getting quotas for user f1c789055f344bb59a86b6d4fe5cac91 and project 5a6b49c60dc845c5a74f3ab5d132740d. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:07.119006 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:49:07.131804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:49:07.424737 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4f6fbc6c-3f4c-4e2c-a207-f98c7c386c43 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.038946 Jul 16 12:49:07.425814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 7/15] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:49:07.436692 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-388c63f4-aad9-4d46-95ab-bed9db364833 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:07.438554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-388c63f4-aad9-4d46-95ab-bed9db364833 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:07.776155 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-388c63f4-aad9-4d46-95ab-bed9db364833 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:07.811155 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-388c63f4-aad9-4d46-95ab-bed9db364833 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1214 microversion: 2.1 time: 0.378827 Jul 16 12:49:07.816917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:07 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1214 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:07.823023 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1347185783", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7dd031c-453e-4167-9cf1-2231fb050c9c"}], "security_groups": [{"name": "tempest-securitygroup--1194744127"}], "key_name": "tempest-keypair-1704046158", "user_data": "}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:08.181925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] validate_networks() for [('c7dd031c-453e-4167-9cf1-2231fb050c9c', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:49:08.755076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:49:08.757344 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:49:08.758096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:49:08.758717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:49:08.759372 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:49:08.788011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:08.788824 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:08.789916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:08.790631 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:08.866570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:08.871640 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for user f1c9a7f942c541a287da38a894f1d1f9 and project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:08.891736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:49:08.891736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:49:09.185235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-44d06f8f-2d67-4fd3-84d5-a8d7c9be05cb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.015250 Jul 16 12:49:09.189498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 9/17] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:49:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 16 12:49:09.200113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-631d5a42-2210-48f7-923a-d6667c2daf7f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:09.200772 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-631d5a42-2210-48f7-923a-d6667c2daf7f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:09.327654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:49:09.327654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:49:09.328837 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:49:09.329277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:49:09.330257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:49:09.366870 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:09.367509 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:09.372824 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:09.374642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:09.440315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-631d5a42-2210-48f7-923a-d6667c2daf7f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:09.454663 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for project f762c3c164904a3bb6e64985744c1765. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:09.469878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for user 3e12d902f94b40cea088dc6f24dcb444 and project f762c3c164904a3bb6e64985744c1765. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:09.486611 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-631d5a42-2210-48f7-923a-d6667c2daf7f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1214 microversion: 2.1 time: 0.295572 Jul 16 12:49:09.490664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 10/18] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:09 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:09.520489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fe3ac8c4-dfce-4df4-8a9d-2c9fd7438d47 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:09.524042 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fe3ac8c4-dfce-4df4-8a9d-2c9fd7438d47 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:09.529795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:49:09.542944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:49:09.637277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fe3ac8c4-dfce-4df4-8a9d-2c9fd7438d47 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:09.651810 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fe3ac8c4-dfce-4df4-8a9d-2c9fd7438d47 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1221 microversion: 2.1 time: 0.157468 Jul 16 12:49:09.652703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 11/19] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:09 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:09.847027 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dd7f776e-df04-4c63-b263-882fa582daa0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.027406 Jul 16 12:49:09.856493 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 9/20] 10.222.0.47 () {62 vars in 1187 bytes} [Sat Jul 16 12:49:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 16 12:49:09.860807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-82fa59cf-0a4c-4618-89ad-446757ca4001 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:09.868512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-82fa59cf-0a4c-4618-89ad-446757ca4001 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:09.913398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1527936695", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:10.007751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] validate_networks() for [('75d58424-1eb7-487d-b17b-bf9f6568128d', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:49:10.153703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-82fa59cf-0a4c-4618-89ad-446757ca4001 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:10.162233 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-82fa59cf-0a4c-4618-89ad-446757ca4001 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:10.168344 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-82fa59cf-0a4c-4618-89ad-446757ca4001 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:10.169637 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-82fa59cf-0a4c-4618-89ad-446757ca4001 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1282 microversion: 2.20 time: 0.313415 Jul 16 12:49:10.173404 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 12/21] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:09 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1282 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:10.509151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c3f0fab2-d94a-4206-8a65-77100fa783c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:10.512832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c3f0fab2-d94a-4206-8a65-77100fa783c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:11.126951 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c3f0fab2-d94a-4206-8a65-77100fa783c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:11.165566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c3f0fab2-d94a-4206-8a65-77100fa783c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1214 microversion: 2.1 time: 0.640829 Jul 16 12:49:11.166632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 13/22] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:10 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1214 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:11.191171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-86413d43-a5f2-401a-8791-623b4b56c0c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:11.192048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-86413d43-a5f2-401a-8791-623b4b56c0c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:11.309588 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:49:11.310152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:49:11.310461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:49:11.311025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:49:11.311582 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:49:11.345999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:11.352285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:11.353881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:11.354540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:11.437092 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:11.460690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86413d43-a5f2-401a-8791-623b4b56c0c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:11.471758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for user f1c9a7f942c541a287da38a894f1d1f9 and project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:11.476007 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86413d43-a5f2-401a-8791-623b4b56c0c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:11.478242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86413d43-a5f2-401a-8791-623b4b56c0c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:11.480960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-86413d43-a5f2-401a-8791-623b4b56c0c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1282 microversion: 2.20 time: 0.294198 Jul 16 12:49:11.488348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 14/23] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:11 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1282 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:11.517846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:49:11.534340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:49:11.772122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6e23f225-cf88-4bf2-9093-4d5db5a3d3eb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.864158 Jul 16 12:49:11.775648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 10/24] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:49:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:49:11.799667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-aff4c093-0dbb-4f24-903f-6f4bafac347d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:11.800813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-aff4c093-0dbb-4f24-903f-6f4bafac347d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:12.064333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-aff4c093-0dbb-4f24-903f-6f4bafac347d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:12.078444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-aff4c093-0dbb-4f24-903f-6f4bafac347d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1222 microversion: 2.1 time: 0.291506 Jul 16 12:49:12.085180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 15/25] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:11 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1222 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:12.188796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:12.191453 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:12.205007 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:12.205441 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:12.206132 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:12.218039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:12.328625 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-980976242", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a354d703-6ba1-41fe-886d-bd8338eb5858"}], "security_groups": [{"name": "tempest-securitygroup--1294681430"}], "key_name": "tempest-keypair-579021624", "user_data": "}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:12.691487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:12.706585 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] validate_networks() for [('a354d703-6ba1-41fe-886d-bd8338eb5858', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:49:12.718004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f8ba3ce7-820b-4fc5-ac28-d48e28f1ad5c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1210 microversion: 2.1 time: 0.536531 Jul 16 12:49:12.722835 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 11/26] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:12 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1210 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:12.745746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:12.747200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:12.766191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:12.767932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:12.769011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:12.770302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:12.872186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:12.888721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:12.896021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:12.898207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3644c7f8-304e-4f03-9cfb-b335d82192b8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1278 microversion: 2.20 time: 0.175239 Jul 16 12:49:12.899125 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 12/27] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:12 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:13.099649 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-78e73820-f731-44e6-9805-a1000c6edd4d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:13.100545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-78e73820-f731-44e6-9805-a1000c6edd4d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:13.406797 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-78e73820-f731-44e6-9805-a1000c6edd4d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:13.418961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-78e73820-f731-44e6-9805-a1000c6edd4d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1222 microversion: 2.1 time: 0.323513 Jul 16 12:49:13.429431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 13/28] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:13 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:13.638445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-418481153", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e589d6d-dffd-4d85-b847-b143776bf015"}], "security_groups": [{"name": "tempest-securitygroup--2015589037"}], "key_name": "tempest-keypair-1212866917", "user_data": "}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:13.922867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] validate_networks() for [('2e589d6d-dffd-4d85-b847-b143776bf015', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:49:14.068132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:49:14.069240 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:49:14.069875 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:49:14.071029 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:49:14.071709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:49:14.120216 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:14.128707 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:14.136232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:14.136786 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:14.226734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:14.239238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:14.274819 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:49:14.277861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:49:14.679213 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-751bcbfe-5d95-41b7-817f-98a5ff587c30 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.354725 Jul 16 12:49:14.683818 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 16/29] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:49:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 16 12:49:14.711928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:14.711928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:14.726880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:14.727715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:14.728719 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:14.729385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:15.004915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:15.040748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5db3fd9f-9504-49db-ba6c-d64f028a4a6d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1272 microversion: 2.1 time: 0.355597 Jul 16 12:49:15.053473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 17/30] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:14 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:15.071139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:15.071951 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:15.081070 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:15.081533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:15.082327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:15.084336 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:15.324813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:15.358000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:15.373866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:15.375301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-86d3252a-3a75-4a2f-af4b-f70567f47cff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1340 microversion: 2.20 time: 0.318585 Jul 16 12:49:15.375878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 18/31] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:15 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1340 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:15.384607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:15.396881 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:15.420007 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:15.422946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:15.425268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:15.426339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:15.764936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:15.775333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5acafb15-050a-403e-92a3-002c547b3ac0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1282 microversion: 2.1 time: 0.394443 Jul 16 12:49:15.775928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 19/32] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:15 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1282 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:15.786983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d63c7018-ed3d-4d9d-a4bf-68561a77c9f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:15.787617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d63c7018-ed3d-4d9d-a4bf-68561a77c9f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:16.244828 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d63c7018-ed3d-4d9d-a4bf-68561a77c9f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:16.255876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d63c7018-ed3d-4d9d-a4bf-68561a77c9f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1240 microversion: 2.1 time: 0.478905 Jul 16 12:49:16.259928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 20/33] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:15 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1240 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:16.284182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:16.284806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:16.295290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:16.295973 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:16.296963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:16.301010 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:16.346986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:49:16.347548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:49:16.347884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:49:16.348304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:49:16.348725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:49:16.364444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:16.364917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:16.365760 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:16.366204 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:16.431160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for project 858d6855277f465497c27313765e5d1a. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:49:16.439621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for user 46b5c80d8bf34965a30b9b67e9117996 and project 858d6855277f465497c27313765e5d1a. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:49:16.455494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:49:16.458355 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:49:16.655917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7001d8a3-7bf1-4a80-83bb-aa873e8d3137 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.022700 Jul 16 12:49:16.665475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 14/34] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:49:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 3033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 16 12:49:16.697975 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:16.701336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:16.743668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:16.753647 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:16.758518 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:16.760127 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:16.980228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:16.993664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-883314e6-726c-4742-a31b-dfe10af85e5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1272 microversion: 2.1 time: 0.724589 Jul 16 12:49:17.005178 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 21/35] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:16 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1272 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:17.011182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9d5ee24c-c166-4739-8f77-27ed50f711e9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:17.012819 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9d5ee24c-c166-4739-8f77-27ed50f711e9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:17.057776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:17.076959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:17.084512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:17.089943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8bec0841-139e-4b1f-9642-a1f3d13464af tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1340 microversion: 2.20 time: 0.419513 Jul 16 12:49:17.090967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 15/36] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:16 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1340 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:17.121128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:17.122859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:17.143948 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:17.148142 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:17.154303 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:17.155405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:17.210501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9d5ee24c-c166-4739-8f77-27ed50f711e9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:17.226133 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9d5ee24c-c166-4739-8f77-27ed50f711e9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1237 microversion: 2.1 time: 0.213633 Jul 16 12:49:17.229639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 22/37] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:17 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1237 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:17.278920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:17.281288 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:17.304878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:17.315577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:17.316030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:17.323250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:17.323745 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:17.622230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:17.622230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-126b3491-52b9-4b51-953c-05cca6efdc8b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1236 microversion: 2.1 time: 0.256878 Jul 16 12:49:17.622230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 23/38] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:17 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1236 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:17.623349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:17.623349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fa956ac1-9be1-4f10-a830-a773fe3617b4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1280 microversion: 2.1 time: 0.437779 Jul 16 12:49:17.623349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 16/39] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:17 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1280 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:18.011762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:18.012504 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:18.030740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:18.030740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:18.030740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:18.032709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:18.111286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:18.112372 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:18.140933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:18.144826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:18.149326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:18.153460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:19.308774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:19.322741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-841e52e2-3325-480c-8885-e0f23f3e9d0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 1.311186 Jul 16 12:49:19.343700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 24/40] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:18 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:19.375607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:19.375607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:19.429730 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:19.434674 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:19.435641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:19.436090 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:19.847484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:19.856294 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a74a91bb-e95d-408d-b76f-5ffc2762b048 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1241 microversion: 2.1 time: 0.503878 Jul 16 12:49:19.871434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 25/41] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:19 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1241 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:19.882045 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:19.884432 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:19.907490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:19.909744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:19.910755 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:19.913848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:20.250551 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:20.267076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d9a05e7e-5377-455e-972d-7b12290e2d9a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1280 microversion: 2.1 time: 0.399998 Jul 16 12:49:20.270086 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 26/42] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:19 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:20.283754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:20.303768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:20.322416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:20.323766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:20.326787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:20.331802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:20.401497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:20.417055 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:20.421750 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:20.427646 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-83363b4e-a44a-4529-a506-fa3bc9e16072 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 2.321903 Jul 16 12:49:20.440604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 17/43] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:18 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:20.469232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:20.472724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:20.482057 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:20.495274 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:20.504477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:20.508153 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:20.511448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:20.798322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:20.806187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-aff61be0-ee42-4b62-83ea-5a2941967cf9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1298 microversion: 2.1 time: 0.530371 Jul 16 12:49:20.809001 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 27/44] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:20 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1298 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:20.879459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:20.880078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:20.907978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:20.908433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:20.913305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:20.913305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:21.333389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:21.346795 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-144bf18e-18c8-45d0-9756-128e6952e3f2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1289 microversion: 2.1 time: 0.471371 Jul 16 12:49:21.356994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 28/45] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:20 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1289 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:21.379013 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:21.379720 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:21.393813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:21.396408 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:21.399353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:21.400251 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:21.614332 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:21.631620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f9d7880c-fe4d-4f51-b8bb-472f67d30d4a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1280 microversion: 2.1 time: 0.262866 Jul 16 12:49:21.632259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 29/46] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:21 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:21.651191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:21.651191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:21.675832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:21.678531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:21.689526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:21.690515 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:21.764907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:21.783592 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8cf996d9-3474-4c6e-a0f5-09f5019b441c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 1.332866 Jul 16 12:49:21.786154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 18/47] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:20 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:21.827526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:21.828593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:21.845510 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:21.849312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:21.852914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:21.857330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:22.853635 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:22.877647 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4694746c-0095-4f63-b4db-910d01d31310 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1298 microversion: 2.1 time: 1.050436 Jul 16 12:49:22.878305 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 19/48] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:21 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1298 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:22.889524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:22.891796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:22.916597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:22.918699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:22.921547 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:22.923395 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:23.146066 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:23.159739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4e8ab6e3-7397-4982-bd70-cc98f8874014 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1295 microversion: 2.1 time: 0.277389 Jul 16 12:49:23.160336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 20/49] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:22 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1295 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:23.174559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:23.185550 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:23.206188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:23.220179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:23.220179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:23.220179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:23.543686 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:23.559191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:23.560703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:23.563450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cdd996e6-59ff-4ca7-87d8-f5ef0aab4969 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 1.918884 Jul 16 12:49:23.565889 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 30/50] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:21 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:23.575429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:23.579103 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:23.600154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:23.600872 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:23.614332 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:23.615014 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.043786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:24.057541 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b5083dec-5de0-4d54-9803-50d6db4cda78 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.896080 Jul 16 12:49:24.061291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 21/51] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:23 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:24.069454 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:24.077933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:24.097136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:24.097597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.118147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:24.118609 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.179332 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=4 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:24.332329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:24.343517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d8109c8e-00d0-4feb-8c48-45b7ffe1a075 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1298 microversion: 2.1 time: 0.280509 Jul 16 12:49:24.345209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 22/52] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:24 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:24.349508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:24.350473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:24.361834 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:24.363181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.364746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:24.365721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.694815 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:24.710908 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ddb39998-f5c2-473b-aba0-89ba3352b760 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 1.143901 Jul 16 12:49:24.715924 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 31/53] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:23 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:24.726597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:24.727786 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:24.733928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:24.734501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.735678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:24.736216 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:24.782508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:24.791984 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e05bd74c-d773-4c67-8781-139470886960 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1295 microversion: 2.1 time: 0.446554 Jul 16 12:49:24.801189 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 23/54] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:24 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1295 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:25.078874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:25.079634 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:25.087443 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.089401 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.093196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.094881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.418027 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:25.426305 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3e1badf6-3b2d-4cb2-8997-b42fcb939fb4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.352137 Jul 16 12:49:25.426957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 24/55] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:25 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:25.478099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:25.488059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:25.489610 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:25.490755 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b37a6b13-631e-427c-a461-7fb67f61ddf9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.771622 Jul 16 12:49:25.491324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 32/56] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:24 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:25.505987 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:25.514586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:25.516062 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.518384 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.519498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.522211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.557744 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-ebc58588-f2e7-478c-b66f-79fef72045d6 req-633a6888-6149-4bd4-95b5-eda2abf52387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebcc2eb-d39a-4f63-b230-f5123240e771", "tag": "6996b97e-e3f7-4879-aaf9-c15358ac96e3"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:25.605387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ebc58588-f2e7-478c-b66f-79fef72045d6 req-633a6888-6149-4bd4-95b5-eda2abf52387 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.606053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ebc58588-f2e7-478c-b66f-79fef72045d6 req-633a6888-6149-4bd4-95b5-eda2abf52387 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.640990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-ebc58588-f2e7-478c-b66f-79fef72045d6 req-633a6888-6149-4bd4-95b5-eda2abf52387 service nova] Creating event network-changed:6996b97e-e3f7-4879-aaf9-c15358ac96e3 for instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 on hv-cinder-83697 Jul 16 12:49:25.642368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ebc58588-f2e7-478c-b66f-79fef72045d6 req-633a6888-6149-4bd4-95b5-eda2abf52387 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124652) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 16 12:49:25.643485 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.643934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.644721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.645514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.658369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.compute.rpcapi [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 16 12:49:25.659518 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124652) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 16 12:49:25.690048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1c7876be-dd83-4bed-baf4-6558b3f516d9 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261511 Jul 16 12:49:25.691036 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 25/57] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:25.772063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-effc841d-50fc-4d74-8137-f031070f4b61 req-80fb0303-f099-4bf9-99a0-c55101933802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d120daff-ba07-423a-bfed-2b960c4d213e", "tag": "6abd981f-9fe6-4ec2-b627-c027d25a31e4"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:25.789996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-effc841d-50fc-4d74-8137-f031070f4b61 req-80fb0303-f099-4bf9-99a0-c55101933802 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.790442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-effc841d-50fc-4d74-8137-f031070f4b61 req-80fb0303-f099-4bf9-99a0-c55101933802 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.802193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-effc841d-50fc-4d74-8137-f031070f4b61 req-80fb0303-f099-4bf9-99a0-c55101933802 service nova] Creating event network-changed:6abd981f-9fe6-4ec2-b627-c027d25a31e4 for instance d120daff-ba07-423a-bfed-2b960c4d213e on hv-cinder-83697 Jul 16 12:49:25.807818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-effc841d-50fc-4d74-8137-f031070f4b61 req-80fb0303-f099-4bf9-99a0-c55101933802 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115350 Jul 16 12:49:25.808965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 26/58] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:25.815073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:25.816124 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:25.823354 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.824369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:25.825411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:25.826272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.022957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.055733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-30a8e916-d78d-4baf-a6f4-7913c0beb1f1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.561470 Jul 16 12:49:26.056336 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 33/59] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:25 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:26.069526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:26.079952 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:26.087265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:26.087992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.088907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:26.089649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.160909 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.175578 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-867e9c83-b45d-4020-a71e-e8cb9bb2a175 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.358565 Jul 16 12:49:26.182028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 27/60] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:25 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:26.324381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.331539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:26.335467 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-367653d1-545c-420e-9426-38d0ed9a6ede tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.275640 Jul 16 12:49:26.348080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 34/61] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:26 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:26.445011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:26.445878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:26.451268 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=32 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:26.453937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:26.454387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.455164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:26.455604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.509527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:26.510204 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:26.523931 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:26.529212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.529212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:26.529212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:26.729591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.740760 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-88d2fcea-43d1-43e1-9775-aee7d9eb5f61 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.300657 Jul 16 12:49:26.750483 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.751763 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 28/62] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:26 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:26.759839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.761639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:26.763029 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-06c5f104-e1f8-40b0-a4ec-525bb5fb2ba8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.257478 Jul 16 12:49:26.764128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 35/63] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:26 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:27.076577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:27.077477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:27.083948 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.084397 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.085218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.085592 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.089451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:27.201613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:27.202999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:27.209803 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.210253 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.211196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.211777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.218823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:27.219676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=36 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:27.227152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8ff1ce24-e7f6-441a-8d5c-05a37d58a4c0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.154199 Jul 16 12:49:27.227805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 29/64] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:27 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:27.345258 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:27.352809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-59faa222-55ed-4a22-b278-eda53bb78abd tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.155293 Jul 16 12:49:27.352969 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:27.353392 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 36/65] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:27 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:27.357873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:27.360276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.360747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.361571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.362040 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.501457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:27.509371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-948bd58e-d2cf-4851-a38f-668c76431a4c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.160172 Jul 16 12:49:27.509951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 30/66] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:27 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:27.707003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-11fb1876-02bb-4fc2-a918-70393f1c4d89 req-9e1b0f43-e203-4bcd-a62d-608334d664bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:27.731485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-11fb1876-02bb-4fc2-a918-70393f1c4d89 req-9e1b0f43-e203-4bcd-a62d-608334d664bd service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.732118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-11fb1876-02bb-4fc2-a918-70393f1c4d89 req-9e1b0f43-e203-4bcd-a62d-608334d664bd service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.755948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-11fb1876-02bb-4fc2-a918-70393f1c4d89 req-9e1b0f43-e203-4bcd-a62d-608334d664bd service nova] Creating event network-changed:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:49:27.756814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-11fb1876-02bb-4fc2-a918-70393f1c4d89 req-9e1b0f43-e203-4bcd-a62d-608334d664bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124651) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 16 12:49:27.758314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:27.758493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.759087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:27.759379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.760415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.761018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.766218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.766738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.767729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.768506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.772255 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.compute.rpcapi [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 16 12:49:27.773504 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] Releasing lock "compute-rpcapi-router" {{(pid=124651) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 16 12:49:27.792160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a4db299b-3e9d-4224-810d-751040fd07dc None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089948 Jul 16 12:49:27.810865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 37/67] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:27.810865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:27.810865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:27.810865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.812053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.812053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.812053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:27.949608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:27.962577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-701fa277-284c-4b29-a230-d2dad5b3decf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.208243 Jul 16 12:49:27.963668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 31/68] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:27 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:27.968452 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-dce843b7-af35-4ec1-9393-17284a8a2b8e req-1ac6c112-f3e1-491f-9668-62d3bc3511bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04ed7dc-6462-48b7-aa58-346840ab65a8", "tag": "c63f1e2e-a829-45d0-8d47-e9557e8bc915"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:27.995933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-dce843b7-af35-4ec1-9393-17284a8a2b8e req-1ac6c112-f3e1-491f-9668-62d3bc3511bb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:27.996381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-dce843b7-af35-4ec1-9393-17284a8a2b8e req-1ac6c112-f3e1-491f-9668-62d3bc3511bb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.009219 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-dce843b7-af35-4ec1-9393-17284a8a2b8e req-1ac6c112-f3e1-491f-9668-62d3bc3511bb service nova] Creating event network-changed:c63f1e2e-a829-45d0-8d47-e9557e8bc915 for instance f04ed7dc-6462-48b7-aa58-346840ab65a8 on hv-cinder-83697 Jul 16 12:49:28.015333 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-dce843b7-af35-4ec1-9393-17284a8a2b8e req-1ac6c112-f3e1-491f-9668-62d3bc3511bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049675 Jul 16 12:49:28.016687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 32/69] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:28.235980 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:28.246105 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:28.246809 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:28.255999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:28.257523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:28.258774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d89713b8-3953-4266-8932-df2177cd2876 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.464611 Jul 16 12:49:28.259330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 38/70] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:27 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:28.260804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.261302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.262165 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.262597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.370178 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:28.413578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:28.413578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.413578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.413578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.414080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.414166 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:28.416778 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-54fd06c5-0f2e-44cb-a46f-e677be798b5a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.175539 Jul 16 12:49:28.417402 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 33/71] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:28 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:28.508772 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:28.517176 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6db8a66b-6700-4642-ac84-b41db33ce614 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.150771 Jul 16 12:49:28.517812 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 39/72] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:28 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:28.528004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:28.528616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:28.535930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.536367 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.537168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.537600 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.686978 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:28.694509 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8fab024c-929a-4edb-8783-60e1ac61d5b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.170285 Jul 16 12:49:28.695066 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 34/73] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:28 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:28.980180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:28.980964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:28.989766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.990489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:28.991246 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:28.991675 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.137983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.146122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2ffd1317-ad55-4ea0-af58-78442b89603c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.169767 Jul 16 12:49:29.155975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 40/74] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:28 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:29.277202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:29.277758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:29.284301 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.291976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.291976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.291976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.411025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.420067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.422430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.423571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-323f9387-509b-4673-8f9f-69777285760e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.150469 Jul 16 12:49:29.431302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 35/75] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:29 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:29.435481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:29.435963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:29.442171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.442930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.443924 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.444560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.534803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:29.535872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:29.541548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.541999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.542771 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.543207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.600871 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.610224 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d2c4f493-f8b2-4044-8877-ebdcd081a749 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.179856 Jul 16 12:49:29.613737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 41/76] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:29 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:29.698883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.707420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9053bdb8-68e7-42b6-89c0-7981b337bb9a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.176253 Jul 16 12:49:29.711942 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 36/77] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:29 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:29.712097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:29.712597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:29.722882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.723506 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.724183 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:29.724782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:29.865175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:29.872520 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7ecb0b84-ce4a-409c-bbd4-1938903a54fc tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.164632 Jul 16 12:49:29.884188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 42/78] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:29 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:30.162710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:30.163322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:30.172586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.172586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.172586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.172586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.339086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:30.348893 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9577f01e-f940-492d-b8cc-1403c80823ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.189969 Jul 16 12:49:30.349834 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 37/79] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:30 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:30.448714 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:30.449782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:30.456865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.457343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.458112 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.458547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.598968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:30.607517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:30.609629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:30.610745 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-50211cd7-2a91-44ad-9191-d4158f3c7cac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.165841 Jul 16 12:49:30.611358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 43/80] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:30 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:30.628561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:30.628561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:30.633957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.634411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.635178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.635675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.724646 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:30.725399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:30.731283 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.731730 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.732487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.732960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.771545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:30.779608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7016a007-447b-4ba8-9b8d-a8118baf87a0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.156065 Jul 16 12:49:30.780961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 38/81] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:30 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:30.872444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:30.880794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4124478a-fd4f-4973-ab15-c97932190000 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.159911 Jul 16 12:49:30.881389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 44/82] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:30 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:30.890414 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:30.891029 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:30.897063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.897524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:30.898286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:30.898729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:31.037501 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:31.044844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-87f6124b-b5f8-4c02-992b-012ebd62518f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.158962 Jul 16 12:49:31.045495 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 39/83] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:30 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:31.366886 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:31.367655 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:31.374380 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:31.374839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:31.375633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:31.376292 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:31.513543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:31.521365 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0237cfb8-09d1-47b4-9298-6fc9bb8a6e82 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.158572 Jul 16 12:49:31.529083 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 45/84] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:31 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:31.630610 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:31.631330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:31.640455 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:31.640966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:31.641962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:31.642409 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:31.801912 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:31.802897 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:31.813784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:31.814673 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:31.816303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:31.816921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:32.224221 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:32.235829 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:32.238512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:32.241422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-52cf8067-1e72-4cb3-9b04-21bfcc0470e6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.615691 Jul 16 12:49:32.243256 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 40/85] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:31 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:32.251049 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:32.252067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:32.255453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:32.268132 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:32.268132 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:32.268132 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:32.268665 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ac2041eb-815c-4628-b30d-02dbc374689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.469976 Jul 16 12:49:32.268760 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:32.269170 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 46/86] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:31 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:32.276701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:32.282503 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:32.297128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:32.297128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:32.297485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:32.298096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:33.170002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:33.193797 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f4511ff7-4484-4642-9997-c3c07c53aa0c tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.948820 Jul 16 12:49:33.195172 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 41/87] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:32 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:33.209155 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:33.213125 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:33.228868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:33.232411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:33.233859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:33.238696 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:33.347115 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:33.358442 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9fbac739-a629-4309-8080-5d99e014ec4b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 1.087641 Jul 16 12:49:33.359671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 47/88] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:32 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:33.383360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:33.383972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:33.394705 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:33.395376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:33.396311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:33.396926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:33.700423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:33.712315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c9335494-b943-44ef-b6dc-d9eff845f23d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.515829 Jul 16 12:49:33.713352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 42/89] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:33 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:33.721694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:33.722478 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:33.730484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:33.731737 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:33.736388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:33.736388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.008479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:34.022818 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:34.024681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:34.027056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b94f44f9-f034-4c7e-8fb4-74b53124e6d5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.665720 Jul 16 12:49:34.028006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 48/90] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:33 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:34.035102 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-7d38d308-1c8f-4dd7-bfff-2cdd98fba838 req-3379975c-3d01-447e-a9b2-aebf4e06efed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56c8229-cd52-4255-9f93-6025d9859b44", "tag": "0d54161e-a36c-4321-a732-74743254790f"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:34.048169 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-7d38d308-1c8f-4dd7-bfff-2cdd98fba838 req-3379975c-3d01-447e-a9b2-aebf4e06efed service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.049105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-7d38d308-1c8f-4dd7-bfff-2cdd98fba838 req-3379975c-3d01-447e-a9b2-aebf4e06efed service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.065891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-7d38d308-1c8f-4dd7-bfff-2cdd98fba838 req-3379975c-3d01-447e-a9b2-aebf4e06efed service nova] Creating event network-changed:0d54161e-a36c-4321-a732-74743254790f for instance b56c8229-cd52-4255-9f93-6025d9859b44 on hv-cinder-83697 Jul 16 12:49:34.072379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-7d38d308-1c8f-4dd7-bfff-2cdd98fba838 req-3379975c-3d01-447e-a9b2-aebf4e06efed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042639 Jul 16 12:49:34.074046 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 49/91] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:34.216808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:34.218099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:34.229197 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.230702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.231825 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.232456 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.309650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:34.320127 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-76d1eb0a-6f7d-41bd-a703-a501b67c44a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.604956 Jul 16 12:49:34.321564 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 43/92] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:33 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:34.382001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:34.388808 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:34.395955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.397616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.398860 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.399487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.760350 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:34.777720 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bf0c2f91-77ab-42e7-88cf-d17c26dbe412 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.569822 Jul 16 12:49:34.778721 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 50/93] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:34 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:34.785072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-991d414a-efab-429e-9d4f-bdfc5a11c24d req-5e6bc594-6502-4f4d-ac2a-eb1bf8cf2814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f070ffc-5fc4-42f9-b2e5-d8420a80af13", "tag": "3c569d6d-b7a5-4017-b67f-7d71f2b5081a"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:34.794439 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-991d414a-efab-429e-9d4f-bdfc5a11c24d req-5e6bc594-6502-4f4d-ac2a-eb1bf8cf2814 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.794877 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-991d414a-efab-429e-9d4f-bdfc5a11c24d req-5e6bc594-6502-4f4d-ac2a-eb1bf8cf2814 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.805608 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-991d414a-efab-429e-9d4f-bdfc5a11c24d req-5e6bc594-6502-4f4d-ac2a-eb1bf8cf2814 service nova] Creating event network-changed:3c569d6d-b7a5-4017-b67f-7d71f2b5081a for instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 on hv-cinder-83697 Jul 16 12:49:34.811398 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-991d414a-efab-429e-9d4f-bdfc5a11c24d req-5e6bc594-6502-4f4d-ac2a-eb1bf8cf2814 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030861 Jul 16 12:49:34.812100 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 51/94] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:34.816964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:34.817697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:34.824690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.824690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.825091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:34.825354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:34.848031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:34.855763 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3a276ebe-115c-4edf-ac0e-c6b3f046d266 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.483973 Jul 16 12:49:34.856336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 44/95] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:34 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:34.991152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:35.000256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-89dc68e9-177d-498d-9c44-a7d70826fb0a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.186982 Jul 16 12:49:35.000998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 52/96] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:34 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:35.048305 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:35.048905 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:35.054986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.055432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.056439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.057050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.241901 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:35.250842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:35.252380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:35.253610 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-372f73e2-e558-4a0d-8010-3a876a89c5bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.209677 Jul 16 12:49:35.254385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 45/97] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:35 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:35.338026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:35.338764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:35.346097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.346620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.347488 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.347995 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.352449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:35.538742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:35.547420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-36f7addb-ef02-4ccb-b5e6-79b46ccd4b90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.213351 Jul 16 12:49:35.547996 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 53/98] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:35 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:35.796436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:35.797190 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:35.811777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=10 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:35.811777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.811777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.811777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.812116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.846312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:35.873056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:35.875070 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:35.886279 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.886944 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.887863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:35.888305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:35.978166 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:35.994498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0fcb7900-5635-4bda-ad88-4accff03eb47 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.203299 Jul 16 12:49:35.995381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 46/99] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:35 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:36.026445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:36.026445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:36.029971 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:36.030622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:36.031566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:36.032315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:36.100318 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:36.111437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4cae6e27-0601-431e-b61d-6a0dde321aab tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.242098 Jul 16 12:49:36.120741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 54/100] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:35 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:36.189063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:36.194909 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e91f6785-9388-41fa-9025-521efd67df75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.178900 Jul 16 12:49:36.195475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 47/101] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:36 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:36.272140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:36.272668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:36.278598 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:36.279045 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:36.279835 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:36.280363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:36.422849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:36.431489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:36.432986 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:36.434183 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-048c7e81-d80a-43b0-8b6e-a8d1cdbb6f36 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.166450 Jul 16 12:49:36.434738 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 55/102] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:36 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:36.565789 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:36.566666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:36.574047 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:36.575368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:36.577105 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:36.577767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:36.775938 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:36.784241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0e818a76-c51c-4145-912b-de92711a364e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.223238 Jul 16 12:49:36.784833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 48/103] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:36 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:37.011920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:37.012612 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:37.018787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.019315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.019971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.020409 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.127786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:37.128394 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:37.134972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.135661 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.136569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.137019 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.202806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.218124 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-40b310a9-5fd7-4e7b-9c7c-8a1aa86611b7 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.208613 Jul 16 12:49:37.220448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 56/104] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:37 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:37.228519 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:37.229904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:37.243301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.244153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.249267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.249267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.386086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.398215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-feb16e94-3c9b-42a6-88e3-9ba3d91e1cff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.274220 Jul 16 12:49:37.400018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 49/105] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:37 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:37.426565 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.434486 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-42706072-f4e1-41e3-8cdb-f74e1f7feaa9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.213307 Jul 16 12:49:37.435076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 57/106] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:37 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:37.452382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:37.453186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:37.459497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.460064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.461015 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.461624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.630861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.641067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.642613 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.644391 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-55170c2d-8738-4fab-8569-175ae9ecba0a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.196617 Jul 16 12:49:37.645304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 50/107] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:37 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:37.800723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:37.801614 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:37.803761 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:37.810311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.811679 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.812463 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:37.812893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:37.972502 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:37.980537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-118edcef-0b52-4750-8ead-ceb6e666afef tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.183535 Jul 16 12:49:37.981109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 58/108] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:37 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:38.236511 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:38.237150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:38.243515 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.243967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.244819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.245286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.414224 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:38.418924 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:38.422898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:38.438269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.440473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.440473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.440473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.442305 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f86db659-fee9-4929-896d-2bf8ef40f439 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.210314 Jul 16 12:49:38.442908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 51/109] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:38 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:38.458813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:38.459410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:38.470742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.473262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.474701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.475359 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.629271 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:38.636933 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c16caee1-87e7-478f-b367-c2fb84f22073 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.225072 Jul 16 12:49:38.638194 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 59/110] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:38 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:38.651405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:38.659545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-56982dd4-3883-424e-aeca-089bbc07f3f5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.205165 Jul 16 12:49:38.660118 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 52/111] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:38 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:38.668150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:38.668969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:38.675643 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.680024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.680024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:38.680024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:38.830018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:38.838457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:38.840041 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:38.841133 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-654ac4a2-ebd3-4487-85b3-972ae0d6ac02 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.177244 Jul 16 12:49:38.841762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 60/112] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:38 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:38.997964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:38.999780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:39.005879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.006330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.007078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.007508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.187667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:39.195084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-78dd9916-1b22-4341-83e1-baabd43f23fd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.201191 Jul 16 12:49:39.205493 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 53/113] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:38 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:39.460818 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:39.461586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:39.468688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.469280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.470419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.471032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.629315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:39.636867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-086c4f10-6d83-4ed0-9e11-b80eae11e6be tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.180794 Jul 16 12:49:39.637493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 61/114] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:39 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:39.664250 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:39.667965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:39.675741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.676217 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.677011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.679109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:39.679728 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:39.681785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.691291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.691751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.700131 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.700640 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.903718 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:39.915479 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-66687bb9-e99f-4e69-9c0a-57b5b2546798 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.255899 Jul 16 12:49:39.916694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 54/115] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:39 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:39.923932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:39.924620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:39.931394 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.931852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:39.932932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:39.933406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.147584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:40.156512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:40.158143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:40.159267 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4fe2fb9c-ceb0-4db0-a811-a8ee58e421c5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.241388 Jul 16 12:49:40.159863 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 55/116] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:39 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:40.215794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:40.216477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:40.226958 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:40.235385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.236072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.240914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.240914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.241715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-da8867c4-d79e-44c6-9abf-d98b305f57d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.566315 Jul 16 12:49:40.241715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 62/117] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:39 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:40.413992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:40.437322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a671b4e9-114c-4f2d-9480-213f42c78b0f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.226925 Jul 16 12:49:40.437912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 56/118] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:40 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:40.630166 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-8194fe27-6eb0-42f1-bc26-dc614bd32436 req-6c875ba7-1680-4ad6-94cf-8765b5d1ce45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebcc2eb-d39a-4f63-b230-f5123240e771", "name": "network-vif-plugged", "status": "completed", "tag": "6996b97e-e3f7-4879-aaf9-c15358ac96e3"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:40.639203 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-8194fe27-6eb0-42f1-bc26-dc614bd32436 req-6c875ba7-1680-4ad6-94cf-8765b5d1ce45 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.640290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-8194fe27-6eb0-42f1-bc26-dc614bd32436 req-6c875ba7-1680-4ad6-94cf-8765b5d1ce45 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.653671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-8194fe27-6eb0-42f1-bc26-dc614bd32436 req-6c875ba7-1680-4ad6-94cf-8765b5d1ce45 service nova] Creating event network-vif-plugged:6996b97e-e3f7-4879-aaf9-c15358ac96e3 for instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 on hv-cinder-83697 Jul 16 12:49:40.659113 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:40.659113 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:40.664740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-8194fe27-6eb0-42f1-bc26-dc614bd32436 req-6c875ba7-1680-4ad6-94cf-8765b5d1ce45 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181839 Jul 16 12:49:40.664934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.666071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 63/119] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:40.672349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.673368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.673878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.819577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:40.828880 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-33d33ae8-4b49-4b3a-84cf-7433e1f98450 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.177354 Jul 16 12:49:40.829821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 57/120] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:40 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:40.935531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:40.936722 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:40.944238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.944780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:40.945770 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:40.946415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.087738 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:41.097654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-85e5f08d-ca5d-4210-91a2-457bd656eb36 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.167061 Jul 16 12:49:41.098714 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 64/121] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:40 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:41.180039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:41.181428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:41.191417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.191934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.192813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.193387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.256922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:41.257619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:41.265853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.266301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.267642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.267642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.339495 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:41.349375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:41.350866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:41.351968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1c3ea47e-2565-4c90-ba4e-ec06187101ba tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.178993 Jul 16 12:49:41.362415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 58/122] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:41 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:41.425455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:41.433416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-eabcc5ac-75f1-44d6-94c8-c74ba2406364 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.180779 Jul 16 12:49:41.433987 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 65/123] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:41 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:41.455259 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:41.455787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:41.461783 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.462235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.462974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.463402 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.599859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:41.607818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cd030f2a-5ae5-4b3e-8414-d01ab1fbb107 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.157497 Jul 16 12:49:41.608407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 59/124] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:41 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:41.847529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:41.847529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:41.853248 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.853691 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:41.854448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:41.854873 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.012823 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.021573 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-68829e3e-dead-4bc9-8375-da8130c2085a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.178939 Jul 16 12:49:42.022239 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 66/125] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:41 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:42.115633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:42.116241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:42.122149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.122597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.123385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.123820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.255766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.263534 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-afd96370-c94c-4597-ac53-7b86e3df064d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.152214 Jul 16 12:49:42.264122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 60/126] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:42 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:42.369646 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:42.370247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:42.376418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.376860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.377636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.378063 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.452387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:42.453413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:42.461972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.462624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.463547 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.464173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.593878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.606076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.608018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.612364 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-eea1bdce-8c3c-45e9-9756-4dd4b2afb5ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.243673 Jul 16 12:49:42.612364 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 67/127] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:42 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:42.630577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:42.631530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:42.641572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.642625 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.643560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.648672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.707860 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.716689 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5d607364-9ded-4128-a941-b2beb0df39ea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.269365 Jul 16 12:49:42.726453 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 61/128] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:42 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:42.732223 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-27248c16-ef69-4362-8f77-5fcf43601aea req-0badb523-1002-488e-b81e-159b2d424b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04ed7dc-6462-48b7-aa58-346840ab65a8", "name": "network-vif-plugged", "status": "completed", "tag": "c63f1e2e-a829-45d0-8d47-e9557e8bc915"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:42.741429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-27248c16-ef69-4362-8f77-5fcf43601aea req-0badb523-1002-488e-b81e-159b2d424b46 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:42.744697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-27248c16-ef69-4362-8f77-5fcf43601aea req-0badb523-1002-488e-b81e-159b2d424b46 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:42.770451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-27248c16-ef69-4362-8f77-5fcf43601aea req-0badb523-1002-488e-b81e-159b2d424b46 service nova] Creating event network-vif-plugged:c63f1e2e-a829-45d0-8d47-e9557e8bc915 for instance f04ed7dc-6462-48b7-aa58-346840ab65a8 on hv-cinder-83697 Jul 16 12:49:42.775562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-27248c16-ef69-4362-8f77-5fcf43601aea req-0badb523-1002-488e-b81e-159b2d424b46 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047591 Jul 16 12:49:42.776513 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 62/129] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:42.869567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:42.878356 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b5647b02-d184-4ae2-aea1-edbdc8f20944 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.256934 Jul 16 12:49:42.878911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 68/130] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:42 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:43.075053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:43.075053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:43.075053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.075053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.077318 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.077318 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.204914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:43.208484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:43.212886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-182e6ced-9a9f-4814-8377-b22972360d8b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.177461 Jul 16 12:49:43.213473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 63/131] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:43 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:43.279658 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:43.280268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:43.286269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.286722 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.287473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.287910 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.424920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:43.432859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-68be881f-8b93-40d8-8b3a-bbfdd948e747 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.157075 Jul 16 12:49:43.433498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 69/132] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:43 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:43.631693 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:43.636723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:43.638744 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.639522 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.640279 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.640709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.734413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:43.735104 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:43.741879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.742407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.743296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.743889 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.762672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:43.775940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:43.785814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:43.789432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:43.789590 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-49099aa4-2366-4b73-9ed8-42fb76052823 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.161685 Jul 16 12:49:43.790240 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 64/133] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:43 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:43.892909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:43.895890 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-029711eb-2778-4978-959c-e6eeb7d56f90 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.165945 Jul 16 12:49:43.896463 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 70/134] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:43 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:43.901851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:43.902601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:43.912859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.913451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:43.914368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:43.914885 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.054086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:44.063888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-af2c1c41-dc47-41e1-ae59-b64a8fc43bde tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.166182 Jul 16 12:49:44.073016 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 65/135] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:43 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:44.232668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:44.233701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:44.239923 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.240372 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.241217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.241657 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.387791 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:44.396007 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-29c8dad5-b780-4cd8-b416-85cda0f15ad5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.167546 Jul 16 12:49:44.399685 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 71/136] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:44 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:44.449110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:44.449922 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:44.455959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.456398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.457187 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.457615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.597894 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:44.605520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bd342320-df8f-439a-a995-735368f929aa tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.160227 Jul 16 12:49:44.606090 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 66/137] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:44 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:44.815254 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:44.816078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:44.824555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.825011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.830666 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.830666 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.913433 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:44.914329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:44.921418 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.922041 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:44.923872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:44.924461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.031325 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.040460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.041928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.043237 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-15d1b305-5a66-4dd2-adf4-5a946e553ff2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.238621 Jul 16 12:49:45.043944 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 72/138] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:44 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:45.084382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:45.085001 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:45.088400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:45.092754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:45.093400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.094177 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:45.094614 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.122304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.135945 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-08fef197-3124-4098-a692-6d63992fcce5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.226463 Jul 16 12:49:45.141198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 67/139] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:44 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:45.243140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.252048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bfcc2240-62bc-42d1-8460-86bf18984d13 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.171441 Jul 16 12:49:45.252621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 73/140] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:45 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:45.413892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:45.414508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:45.417422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:45.421121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:45.421568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.422439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:45.422873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.557278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.566405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c8dc4685-64e1-4938-bdf8-2055289efec8 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.156215 Jul 16 12:49:45.567253 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 68/141] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:45 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:45.626920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:45.627760 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:45.634450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:45.635024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.635891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:45.636616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:45.908036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:45.918287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d00043fd-bf6e-4ca0-9237-2aae0ab44984 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.296046 Jul 16 12:49:45.924555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 74/142] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:45 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:46.062928 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:46.063449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:46.069538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.069978 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.070735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.071163 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.154583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:46.156218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:46.162756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.163202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.163992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.164418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.211769 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:46.220589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:46.222271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:46.223417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0009698c-c4d9-428f-b8e0-0391156b6cd3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.164565 Jul 16 12:49:46.223980 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 69/143] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:46 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:46.269851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:46.270728 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:46.276966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.277617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.279357 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.279357 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.304816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:46.315066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c482f003-906b-42e8-9583-4dd1d48a62c0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.164732 Jul 16 12:49:46.315848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 75/144] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:46 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:46.427891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:46.435759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9a9e10ce-584d-49e4-a6f2-9b21c2adebbc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.169980 Jul 16 12:49:46.436606 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 70/145] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:46 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:46.584874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:46.585751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:46.591915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.592464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.593517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.593909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.728881 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:46.736354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7e4bf336-a16e-4db3-8d45-eaacfaaaeefa tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.155304 Jul 16 12:49:46.736913 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 76/146] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:46 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:46.937215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:46.938183 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:46.944166 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.944689 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:46.945548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:46.946054 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.102151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.116607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-3af4b410-7f2b-41e4-b1e0-ec38d2277a36 req-f0776d82-0480-48c6-9947-9f32d7fb82c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d120daff-ba07-423a-bfed-2b960c4d213e", "name": "network-vif-plugged", "status": "completed", "tag": "6abd981f-9fe6-4ec2-b627-c027d25a31e4"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:47.126805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-eb7809eb-00f3-40bf-9bc6-3b4459099aa8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.194576 Jul 16 12:49:47.130537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3af4b410-7f2b-41e4-b1e0-ec38d2277a36 req-f0776d82-0480-48c6-9947-9f32d7fb82c4 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.130971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3af4b410-7f2b-41e4-b1e0-ec38d2277a36 req-f0776d82-0480-48c6-9947-9f32d7fb82c4 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.131680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 71/147] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:46 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:47.142921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-3af4b410-7f2b-41e4-b1e0-ec38d2277a36 req-f0776d82-0480-48c6-9947-9f32d7fb82c4 service nova] Creating event network-vif-plugged:6abd981f-9fe6-4ec2-b627-c027d25a31e4 for instance d120daff-ba07-423a-bfed-2b960c4d213e on hv-cinder-83697 Jul 16 12:49:47.147808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-3af4b410-7f2b-41e4-b1e0-ec38d2277a36 req-f0776d82-0480-48c6-9947-9f32d7fb82c4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Jul 16 12:49:47.148381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 77/148] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:47.242388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:47.243462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:47.255104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.255801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.256587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.257169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.332545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:47.333870 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:47.341497 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.343471 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.344315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.344850 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.498572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.510346 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.511636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.512919 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.514574 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-562657d0-5a52-493c-89a8-813a15689cfa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.277103 Jul 16 12:49:47.515796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 72/149] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:47 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:49:47.521888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:47.522963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7d80fdf3-95fc-48d3-93fa-b137354f6951 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.194162 Jul 16 12:49:47.523075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:47.526416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 78/150] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:47 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:47.531171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.531841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.532994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.533526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.712071 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.720817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1e1776c2-7996-49a5-9f64-191a7a75d3d0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.203820 Jul 16 12:49:47.730742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 73/151] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:47 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:47.753590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:47.754045 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:47.760096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.760533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.761518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:47.761950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:47.910373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:47.920093 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c1c92b00-f12e-4ec3-94c3-36c47b66599d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.170145 Jul 16 12:49:47.921702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 79/152] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:47 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:48.147579 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:48.149723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:48.156273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.156800 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.157664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.158164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.289696 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:48.301738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5ada919d-d406-4be5-970f-e51ffa38ab5e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.155415 Jul 16 12:49:48.301738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 74/153] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:48 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:48.539343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:48.539949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:48.547856 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:48.549008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:48.560563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.561609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.571151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.571151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.571378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.571378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.571378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.571378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.778966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:48.787087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b2f76d06-52ff-4b0e-beef-e507653dbb29 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.243233 Jul 16 12:49:48.787708 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 75/154] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:48 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:48.794499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:48.795254 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:48.801686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.802136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.802896 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.803326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.909114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:48.921114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:48.922552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:48.929999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-51b94399-5ac9-40db-9994-75690aade30e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.388206 Jul 16 12:49:48.929999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 80/155] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:48 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:48.941321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:48.941940 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:48.948565 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.949009 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.949801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:48.950267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:48.959640 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:48.967097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7d8cb43a-8852-4d39-b59d-2e218c3e2a61 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.176319 Jul 16 12:49:48.968208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 76/156] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:48 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:49.153638 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:49.162198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-2d6b0557-ef7f-4005-8c00-dd6e262a5338 req-0704039f-3de6-4eb5-b054-0be6a02ff416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "name": "network-vif-plugged", "status": "completed", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:49.162768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1152b543-ef3e-46d7-b264-21ee338f54e0 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.224732 Jul 16 12:49:49.163774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 81/157] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:48 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:49.176714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-2d6b0557-ef7f-4005-8c00-dd6e262a5338 req-0704039f-3de6-4eb5-b054-0be6a02ff416 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.177219 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-2d6b0557-ef7f-4005-8c00-dd6e262a5338 req-0704039f-3de6-4eb5-b054-0be6a02ff416 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:49.190460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-2d6b0557-ef7f-4005-8c00-dd6e262a5338 req-0704039f-3de6-4eb5-b054-0be6a02ff416 service nova] Creating event network-vif-plugged:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:49:49.195633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-2d6b0557-ef7f-4005-8c00-dd6e262a5338 req-0704039f-3de6-4eb5-b054-0be6a02ff416 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Jul 16 12:49:49.196242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 77/158] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:49:49.317471 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:49.318089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:49.326783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.326783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:49.326783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.326783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:49.531585 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:49.539414 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-856df743-f4c4-4e9f-82db-7d40cd393c5a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.225801 Jul 16 12:49:49.539997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 82/159] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:49 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:49.804501 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:49.805904 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:49.816210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.818872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:49.820226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.822936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:49.943690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:49.943690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:49.961099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.961696 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:49.962759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:49.963251 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.123418 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.132100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d1506fae-4f56-4b7c-a1ad-38a46feeb04a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1322 microversion: 2.1 time: 0.331844 Jul 16 12:49:50.132737 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 78/160] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:49 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:50.146261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:50.147036 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:50.160400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:50.161013 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.162141 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:50.162808 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.309296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.328603 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.330911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.332756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-820ac2a0-b120-4279-9493-9681d1c74634 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.394194 Jul 16 12:49:50.334010 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 83/161] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:49 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:50.339286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:50.340158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:50.349907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:50.350590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.351571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:50.352185 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.413884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.422206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6ae7217e-cb85-43d4-a7ad-f498d72e16ad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.283582 Jul 16 12:49:50.422784 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 79/162] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:50 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:50.557170 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:50.557786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:50.564430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:50.564880 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.566210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:50.566210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:50.566914 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.574821 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-86f4bde2-11e1-4e2d-9ca7-7630e4e0dde9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1314 microversion: 2.1 time: 0.239593 Jul 16 12:49:50.575394 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 84/163] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:50 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:50.771319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:50.780765 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-96bfe22c-c445-4795-bccd-c3dfc78d82be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.226924 Jul 16 12:49:50.781385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 80/164] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:50 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:51.149188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:51.149789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.156315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.156764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.157545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.157971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.322848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:51.332170 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bcfe4bab-cdc8-4171-9a21-57bd19bd3a3b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1517 microversion: 2.1 time: 0.186781 Jul 16 12:49:51.332739 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 85/165] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:51 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:51.351476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:51.352315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:51.352539 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.353338 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.361286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.362001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.362121 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.363083 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.363202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.363820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.364564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.365005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.392685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:51.427606 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lazy-loading 'flavor' on Instance uuid f04ed7dc-6462-48b7-aa58-346840ab65a8 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:49:51.520060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:51.528550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:51.530431 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:51.531923 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b815646c-afca-4055-bc3f-ad8be5c299aa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.184098 Jul 16 12:49:51.532617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 86/166] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:51 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:51.540335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:51.541150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.552781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.552781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.552781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.552781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.711461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:51.716467 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:49:51.721442 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-96f70655-dc68-46ba-9a7d-c3eb4b55d406 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.184967 Jul 16 12:49:51.722076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 87/167] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:51 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:51.727482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:51.728470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.735397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.736032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.736957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.737415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.737517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-451d4499-0c8d-4503-b0a9-a72b10bfa101 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8/action" status: 200 len: 32 microversion: 2.1 time: 0.390497 Jul 16 12:49:51.738362 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 81/168] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:49:51 2022] POST /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 16 12:49:51.759809 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:51.760910 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.777427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.778174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.779341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.782174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.915767 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:51.925918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5fabac51-522f-41f7-8466-a987a6cef3d5 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1501 microversion: 2.1 time: 0.202323 Jul 16 12:49:51.927127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 88/169] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:51 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:51.941718 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:51.942591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:51.950330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.950997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:51.959166 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:51.959688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:52.048909 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:52.064518 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d7769be8-52ce-414c-b661-63b8082ff966 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.318367 Jul 16 12:49:52.065657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 82/170] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:51 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:52.227736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:52.239499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5f3d74e5-aaba-497c-bf19-f517cb7b40db tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.310104 Jul 16 12:49:52.240653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 89/171] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:51 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:52.305981 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-c59927c1-bae2-4504-96ad-fd4c77fceee1 req-d23de01a-f689-4d40-bf3c-400bc5594577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56c8229-cd52-4255-9f93-6025d9859b44", "name": "network-vif-plugged", "status": "completed", "tag": "0d54161e-a36c-4321-a732-74743254790f"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:52.314793 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-c59927c1-bae2-4504-96ad-fd4c77fceee1 req-d23de01a-f689-4d40-bf3c-400bc5594577 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:52.315396 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-c59927c1-bae2-4504-96ad-fd4c77fceee1 req-d23de01a-f689-4d40-bf3c-400bc5594577 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:52.327598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-c59927c1-bae2-4504-96ad-fd4c77fceee1 req-d23de01a-f689-4d40-bf3c-400bc5594577 service nova] Creating event network-vif-plugged:0d54161e-a36c-4321-a732-74743254790f for instance b56c8229-cd52-4255-9f93-6025d9859b44 on hv-cinder-83697 Jul 16 12:49:52.332736 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-c59927c1-bae2-4504-96ad-fd4c77fceee1 req-d23de01a-f689-4d40-bf3c-400bc5594577 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Jul 16 12:49:52.333540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 83/172] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:52.552218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:52.552900 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:52.560688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:52.563297 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:52.563297 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:52.563297 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:52.752361 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:52.753786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:52.778398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:52.779344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:52.781091 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:52.781796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:52.968287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:52.995693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:52.999931 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:53.004262 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c562ef32-ab23-415a-9abe-d4538d657c54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1408 microversion: 2.20 time: 0.456688 Jul 16 12:49:53.005276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 90/173] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:52 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:53.082279 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:53.083131 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:53.089680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:53.090312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:53.091821 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:53.092303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:53.273020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:53.274082 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:53.291240 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-421726ea-2719-4ecf-a2ae-a616040aa298 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.552582 Jul 16 12:49:53.301516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-739dd96e-7644-499b-8eb6-8b7ba6ddfaf5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.219416 Jul 16 12:49:53.301516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 91/174] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:53 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:53.302207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 84/175] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:52 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:53.307140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:53.307920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:53.314723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:53.315167 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:53.316313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:53.317768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:53.470545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:53.484943 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-220ea372-5046-409f-bbaf-ed4fcfdc00d5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.185266 Jul 16 12:49:53.485452 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 92/176] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:53 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:54.023297 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:54.023938 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:54.031456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.032241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.034616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.035123 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.215454 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:54.224261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:54.225790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:54.227168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-24b3a355-2341-4dcf-84cf-d77f2ec6fc89 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1600 microversion: 2.20 time: 0.207732 Jul 16 12:49:54.227748 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 85/177] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:49:54 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1600 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:49:54.254705 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:54.255178 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:54.261437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.261914 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.262685 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.263119 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.309917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:54.311400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:54.320671 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.321078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.322841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.324285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.401792 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e4a03fd0-f75d-4743-bab8-8d66c423064f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.150473 Jul 16 12:49:54.402572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 93/178] 10.222.0.47 () {60 vars in 1315 bytes} [Sat Jul 16 12:49:54 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:49:54.408274 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:54.408885 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:54.416568 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.417024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.417997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.418434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.597605 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:54.606373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9cebcaae-5217-488b-982e-c9b5448695a8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.202410 Jul 16 12:49:54.607072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 94/179] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:54 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:54.612432 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-f40b9bf2-19a6-4321-99f1-07aee9506dbd req-2a652f60-9c43-4422-a60b-1175e755f90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f070ffc-5fc4-42f9-b2e5-d8420a80af13", "name": "network-vif-plugged", "status": "completed", "tag": "3c569d6d-b7a5-4017-b67f-7d71f2b5081a"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:54.622211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-f40b9bf2-19a6-4321-99f1-07aee9506dbd req-2a652f60-9c43-4422-a60b-1175e755f90c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.622709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-f40b9bf2-19a6-4321-99f1-07aee9506dbd req-2a652f60-9c43-4422-a60b-1175e755f90c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.634060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-f40b9bf2-19a6-4321-99f1-07aee9506dbd req-2a652f60-9c43-4422-a60b-1175e755f90c service nova] Creating event network-vif-plugged:3c569d6d-b7a5-4017-b67f-7d71f2b5081a for instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 on hv-cinder-83697 Jul 16 12:49:54.640120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-f40b9bf2-19a6-4321-99f1-07aee9506dbd req-2a652f60-9c43-4422-a60b-1175e755f90c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030973 Jul 16 12:49:54.640910 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 95/180] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:54.646711 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:54.647400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:54.653747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.654192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.657985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.657985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.666362 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:54.674573 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dbaaeb91-85c5-4426-8690-440c66458c6c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.369626 Jul 16 12:49:54.675422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 86/181] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:54 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:54.794030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "928c13f0-3769-4dab-813f-7bced3098a40"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:54.795388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:54.800229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:54.801569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.802196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.803264 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:54.804338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:54.808366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-64a034e2-d265-4bf2-a2b2-34fb6f7cc8bd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.166238 Jul 16 12:49:54.808935 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 96/182] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:54 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:55.623760 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:55.624758 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:55.630952 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:55.631389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:55.632149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:55.632604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:55.791956 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:55.800474 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4287d48e-3f4a-40f3-958f-f8e78adf69df tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.181220 Jul 16 12:49:55.801159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 97/183] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:55 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:55.805934 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:55.806975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:55.814754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:55.815521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:55.816594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:55.817273 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:56.011634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:56.023315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c39cf744-3fbb-4d9c-bb50-111cd5fb4004 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.221073 Jul 16 12:49:56.023996 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 98/184] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:55 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:56.030789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:56.031613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:56.038229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:56.038908 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:56.039873 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:56.040475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:56.246083 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:56.254658 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-492404a4-89b3-4bab-8eba-7a3a6a72ae5c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1363 microversion: 2.1 time: 0.229737 Jul 16 12:49:56.255237 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 99/185] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:56 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:56.259950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-05b160e7-961d-4b48-adfd-742502897b7f req-567ce418-29fc-4534-9824-6157b12f1e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:56.270581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-05b160e7-961d-4b48-adfd-742502897b7f req-567ce418-29fc-4534-9824-6157b12f1e29 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:56.271236 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-05b160e7-961d-4b48-adfd-742502897b7f req-567ce418-29fc-4534-9824-6157b12f1e29 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:56.286780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-05b160e7-961d-4b48-adfd-742502897b7f req-567ce418-29fc-4534-9824-6157b12f1e29 service nova] Creating event network-changed:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:49:56.293475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-05b160e7-961d-4b48-adfd-742502897b7f req-567ce418-29fc-4534-9824-6157b12f1e29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037067 Jul 16 12:49:56.294160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 100/186] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:56.516432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-01f2cedb-6a1d-442f-ace4-a4d1caaa6a0e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "POST /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.726243 Jul 16 12:49:56.522582 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 87/187] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:49:54 2022] POST /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771/os-volume_attachments => generated 194 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:49:56.818546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:56.819374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:56.825862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:56.826412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:56.827238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:56.827738 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:56.967004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:56.975096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e47554f3-8083-467a-a1f5-5af72d0a9521 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.160818 Jul 16 12:49:56.975860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 101/188] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:56 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:57.042553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:57.044173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:57.057361 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:57.057790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:57.058560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:57.058977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:57.271485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:57.272030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:57.284997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:57.285681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:57.286596 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:57.287172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:57.301103 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:57.346127 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7fbd5ffb-3b36-4c6a-b629-6777ef0be727 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.310035 Jul 16 12:49:57.366154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 88/189] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:57 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:57.490410 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:57.498580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3b18596e-2340-4ea0-b37e-25c9119c74dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1549 microversion: 2.1 time: 0.231207 Jul 16 12:49:57.499270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 102/190] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:57 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1549 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:57.519931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:57.520444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:57.526507 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:57.527133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:57.528046 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:57.528505 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:57.624168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-67f222ac-ee7b-4978-8803-bf01705aaf6e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108195 Jul 16 12:49:57.625087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 89/191] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:49:57 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:57.992927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:57.993581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:58.001426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:58.001797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:58.003276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:58.003875 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:58.369276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:58.373620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:58.374340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:58.381232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:58.384167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:58.384167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:58.384167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:58.384663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-062d1259-c9f5-4a47-852c-8679eee7df52 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.394009 Jul 16 12:49:58.384663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 103/192] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:57 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:58.635988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:58.646670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1e30b834-26c7-4974-8211-8cbc65ae7f90 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.279218 Jul 16 12:49:58.647252 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 90/193] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:58 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:49:59.401081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:59.402460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:59.411123 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:59.411645 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:59.412580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:59.413181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:59.552319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-fb7283f9-3d6a-4db6-8706-14b7022a2886 req-6ea8a688-f8f3-464a-a923-12fb1e0104c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b56c8229-cd52-4255-9f93-6025d9859b44", "tag": "0d54161e-a36c-4321-a732-74743254790f"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:49:59.568219 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-fb7283f9-3d6a-4db6-8706-14b7022a2886 req-6ea8a688-f8f3-464a-a923-12fb1e0104c6 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:59.568969 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-fb7283f9-3d6a-4db6-8706-14b7022a2886 req-6ea8a688-f8f3-464a-a923-12fb1e0104c6 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:59.591075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-fb7283f9-3d6a-4db6-8706-14b7022a2886 req-6ea8a688-f8f3-464a-a923-12fb1e0104c6 service nova] Creating event network-changed:0d54161e-a36c-4321-a732-74743254790f for instance b56c8229-cd52-4255-9f93-6025d9859b44 on hv-cinder-83697 Jul 16 12:49:59.594899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-fb7283f9-3d6a-4db6-8706-14b7022a2886 req-6ea8a688-f8f3-464a-a923-12fb1e0104c6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047657 Jul 16 12:49:59.596031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 91/194] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:49:59.601081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:59.610207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-000d591a-b062-4aff-815e-5807b96cd4cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.213677 Jul 16 12:49:59.611106 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 104/195] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:59 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:49:59.664987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:49:59.665996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:49:59.676193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:59.676722 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:59.677727 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:49:59.678349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:49:59.928600 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:49:59.936237 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8ab18a19-eea8-441f-9eaf-604010a500d4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1366 microversion: 2.1 time: 0.275902 Jul 16 12:49:59.945773 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 92/196] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:49:59 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:00.628718 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:00.630265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:00.636822 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:00.640149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:00.640149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:00.640149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:00.836722 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:00.846256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-03e8f5bb-dc18-4f6b-ad58-af28b71a2ec0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.221158 Jul 16 12:50:00.847008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 105/197] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:00 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:00.959637 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:00.961339 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:00.970665 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:00.971741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:00.973509 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:00.974142 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:01.136729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:01.145622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6006f62d-8ce3-428e-9fc7-15686f6e8587 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1555 microversion: 2.1 time: 0.189739 Jul 16 12:50:01.150351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 93/198] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:00 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:01.163313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:01.163806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:01.170060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:01.170520 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:01.171287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:01.171704 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:01.176671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:01.275181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-57ce7536-425b-462c-b07d-e894b5384316 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111969 Jul 16 12:50:01.275181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 106/199] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:50:01 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:50:01.863954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:01.864641 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:01.879775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:01.879775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:01.879775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:01.879775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:02.023611 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:02.035363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b5c8fe3c-09bd-4385-b6c0-a77c3330d468 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.174975 Jul 16 12:50:02.041080 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 94/200] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:01 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:02.681258 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-2895209e-46f1-4d4d-b34d-516d5d4a77b2 req-ce3b7210-f963-4949-b830-bdfaeeb64f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f070ffc-5fc4-42f9-b2e5-d8420a80af13", "tag": "3c569d6d-b7a5-4017-b67f-7d71f2b5081a"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:50:02.689950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-2895209e-46f1-4d4d-b34d-516d5d4a77b2 req-ce3b7210-f963-4949-b830-bdfaeeb64f2f service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:02.690382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-2895209e-46f1-4d4d-b34d-516d5d4a77b2 req-ce3b7210-f963-4949-b830-bdfaeeb64f2f service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:02.702908 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-2895209e-46f1-4d4d-b34d-516d5d4a77b2 req-ce3b7210-f963-4949-b830-bdfaeeb64f2f service nova] Creating event network-changed:3c569d6d-b7a5-4017-b67f-7d71f2b5081a for instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 on hv-cinder-83697 Jul 16 12:50:02.707107 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-2895209e-46f1-4d4d-b34d-516d5d4a77b2 req-ce3b7210-f963-4949-b830-bdfaeeb64f2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029825 Jul 16 12:50:02.711516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 107/201] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:50:03.054386 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:03.056066 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:03.067234 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:03.067987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:03.069214 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:03.069934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:03.237913 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:03.249235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-570e2094-3908-4a43-804a-39bb0ad6119e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.199142 Jul 16 12:50:03.250121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 95/202] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:03 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:04.267635 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:04.268343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:04.274822 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:04.275267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:04.276015 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:04.276448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:04.407066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:04.414489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-afb992d4-6078-4b94-b291-c17388673cd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.151863 Jul 16 12:50:04.415068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 108/203] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:04 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:05.431794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:05.432296 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:05.438751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:05.439191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:05.439936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:05.440364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:05.444408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:05.580279 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:05.584053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4a89b25c-fa3e-4f0d-8126-f1e15a618c03 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.156417 Jul 16 12:50:05.584625 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 96/204] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:05 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:06.601894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:06.602496 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:06.609379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:06.609817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:06.610560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:06.611046 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:06.748353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:06.759468 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-17cab1c1-b2a5-4ef4-a847-50204a85aee8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.161340 Jul 16 12:50:06.769845 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 109/205] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:06 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:07.778232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:07.782174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:07.786559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:07.787009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:07.787769 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:07.788200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:07.949667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:07.960554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0d3d6f12-7dad-4d05-a7af-ffbbe18914f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.186808 Jul 16 12:50:07.961142 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 97/206] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:07 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:08.977933 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:08.979236 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:08.985588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:08.986765 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:08.987527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:08.987962 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:09.124255 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:09.131636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-85b8127c-4db7-4cc8-9759-fa2346e630b8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.158519 Jul 16 12:50:09.132204 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 110/207] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:08 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:10.149086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:10.149703 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:10.156176 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:10.156638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:10.157588 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:10.158026 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:10.296486 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:10.304052 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-81308c90-6775-4f77-aeff-35a89b9eaefa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.158830 Jul 16 12:50:10.309575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 98/208] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:10 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:11.322713 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:11.323352 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:11.330394 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:11.332579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:11.332579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:11.332579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:11.464588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:11.473024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-932d7a94-4979-49fe-9a82-b6c08ee38e02 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.154672 Jul 16 12:50:11.473639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 111/209] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:11 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:12.490192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:12.490883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:12.499577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:12.500538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:12.501023 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:12.501552 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:12.644607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:12.652048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6502b831-d7fc-4dba-abc0-f046556a141f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.165765 Jul 16 12:50:12.652616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 99/210] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:12 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:12.870198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:12.870736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:12.877524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:12.879006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:12.879631 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:12.880129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:12.906694 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:50:13.208147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9d38f34d-e894-4539-b62b-9210500ec999 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 204 len: 0 microversion: 2.1 time: 0.341395 Jul 16 12:50:13.208813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 112/211] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:50:12 2022] DELETE /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:50:13.216795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:13.217434 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:13.230440 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:13.233210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:13.233210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:13.233210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:13.388591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:13.396577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0a0f3076-0431-4005-a9a8-92f752060d0f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.183603 Jul 16 12:50:13.397165 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 100/212] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:13 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:13.670481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:13.671204 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:13.677954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:13.678398 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:13.679153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:13.679946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:13.814029 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:13.821544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f9304b87-9d41-4077-9d19-9fd9e333e849 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.155396 Jul 16 12:50:13.822116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 113/213] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:13 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:14.413885 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:14.414420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:14.421059 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:14.424655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:14.424655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:14.424655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:14.554244 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:14.563300 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bcc81ea1-2d75-4c8f-8406-851b722827c4 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.153311 Jul 16 12:50:14.567847 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 101/214] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:14 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:14.843919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:14.844443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:14.850493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:14.850947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:14.851703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:14.852136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:14.979626 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:14.987843 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-43c66d34-3ac6-462d-b992-ebd8a1d4837b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.147861 Jul 16 12:50:14.993159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 114/215] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:14 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:15.580339 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:15.582427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:15.583359 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=67 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:15.588029 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:15.588475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:15.589248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:15.589674 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:15.720399 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:15.728327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b683f403-c517-4c25-8f1c-3f9363baec5d tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.152502 Jul 16 12:50:15.728895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 102/216] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:15 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:16.004715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:16.005357 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:16.007270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:16.011946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:16.018182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:16.018182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:16.018182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:16.146682 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:16.153964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-908ffba3-b6ab-4fc6-80fa-59c36fe05343 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.153604 Jul 16 12:50:16.154525 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 115/217] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:15 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:16.745481 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:16.745989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:16.752404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:16.752841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:16.753620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:16.754052 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:16.884453 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:16.893010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8b172dd7-0f42-411b-ad22-a0b75b368b96 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.151452 Jul 16 12:50:16.893593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 103/218] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:16 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:17.169942 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:17.170560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:17.177657 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:17.178113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:17.178879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:17.179570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:17.306742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:17.314799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-dd216376-4f8d-4946-9112-2a0754f08eea tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.148750 Jul 16 12:50:17.315362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 116/219] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:17 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:17.910170 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:17.910776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:17.917213 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:17.917655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:17.918401 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:17.918831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:18.044131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:18.052758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b98812a5-4c97-4859-9bee-2b1091af45ed tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.146933 Jul 16 12:50:18.053364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 104/220] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:17 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:18.331693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:18.332293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:18.338150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:18.338598 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:18.339365 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:18.339788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:18.465922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:18.474109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a6b2ed57-19d3-4935-9605-110eb002dcbb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.146632 Jul 16 12:50:18.474679 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 117/221] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:18 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:19.069859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:19.070474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:19.076752 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:19.077238 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:19.078500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:19.078937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:19.206790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:19.214799 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-047f6629-e90e-477f-94f0-43327b8c6b76 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.148720 Jul 16 12:50:19.215408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 105/222] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:19 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:19.490951 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:19.491490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:19.497858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:19.498253 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:19.498917 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:19.499353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:19.630520 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:19.637948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-37cdb09a-3c22-4147-a796-57729d431948 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.151006 Jul 16 12:50:19.638534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 118/223] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:19 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:20.232761 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:20.233388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:20.240216 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:20.240657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:20.241431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:20.241863 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:20.373943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:20.382102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6f4d2400-cfc4-4253-b385-5ae15f720f1a tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.153182 Jul 16 12:50:20.382668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 106/224] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:20 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:20.655301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:20.655907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:20.662711 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:20.663158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:20.663907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:20.664335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:20.798277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:20.806027 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-25e65262-7fa1-4398-aaea-86356c710922 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.154719 Jul 16 12:50:20.806587 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 119/225] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:20 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:21.401010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:21.402591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:21.411746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:21.413386 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:21.414606 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:21.415045 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:21.544720 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:21.556733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c0537113-39ab-4f80-8796-f4d9cca14dce tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1553 microversion: 2.1 time: 0.158395 Jul 16 12:50:21.557731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 107/226] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:21 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:21.678360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-4073342d-5b1a-4f5e-aea4-c4c64f3cf517 req-68608582-e3a3-40d4-b12d-56ffe5f02fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebcc2eb-d39a-4f63-b230-f5123240e771", "name": "network-vif-deleted", "tag": "6996b97e-e3f7-4879-aaf9-c15358ac96e3"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:50:21.691432 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-4073342d-5b1a-4f5e-aea4-c4c64f3cf517 req-68608582-e3a3-40d4-b12d-56ffe5f02fda service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:21.692403 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-4073342d-5b1a-4f5e-aea4-c4c64f3cf517 req-68608582-e3a3-40d4-b12d-56ffe5f02fda service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:21.709405 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-4073342d-5b1a-4f5e-aea4-c4c64f3cf517 req-68608582-e3a3-40d4-b12d-56ffe5f02fda service nova] Creating event network-vif-deleted:6996b97e-e3f7-4879-aaf9-c15358ac96e3 for instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 on hv-cinder-83697 Jul 16 12:50:21.711162 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-4073342d-5b1a-4f5e-aea4-c4c64f3cf517 req-68608582-e3a3-40d4-b12d-56ffe5f02fda service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036429 Jul 16 12:50:21.712226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 120/227] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:50:21.823296 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:21.823916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:21.830881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:21.831750 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:21.832526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:21.833202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:21.974795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:21.982274 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e8429b58-6f29-44be-a7fe-766fb6436b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.163363 Jul 16 12:50:21.982841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 108/228] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:21 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:22.575897 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:22.576595 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:22.584229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:22.584889 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:22.587649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:22.587649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:22.629229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:22.629955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:22.630428 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lazy-loading 'fault' on Instance uuid 8ebcc2eb-d39a-4f63-b230-f5123240e771 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:50:22.687672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:22.695742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6b4516ec-6b1b-4f9b-a14e-93441b674731 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1350 microversion: 2.1 time: 0.124566 Jul 16 12:50:22.696683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 121/229] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:22 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:23.001031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:23.001675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:23.008313 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:23.008764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:23.009561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:23.009996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:23.195583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:23.206991 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a38c0674-2212-42da-bf1b-1a8f57994ffd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.211159 Jul 16 12:50:23.207665 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 109/230] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:22 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:23.719809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:23.720420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:23.726458 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:23.727602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:23.727703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:23.728117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:23.749306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:23.759297 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:23.759748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:23.760189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lazy-loading 'fault' on Instance uuid 8ebcc2eb-d39a-4f63-b230-f5123240e771 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:50:23.800400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:23.808551 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b9cc8c21-96be-4188-ba8a-2649c0ca676e tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1350 microversion: 2.1 time: 0.092762 Jul 16 12:50:23.809130 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 122/231] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:23 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:24.224380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:24.224990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:24.232297 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:24.232775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:24.233606 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:24.234906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:24.370517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:24.380174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-271848bc-9563-43b0-9676-d16b93338eec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.159478 Jul 16 12:50:24.381085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 110/232] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:24 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:24.826403 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:24.827006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:24.835487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:24.835964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:24.836767 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:24.837232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:24.867160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:24.867612 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:24.868055 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lazy-loading 'fault' on Instance uuid 8ebcc2eb-d39a-4f63-b230-f5123240e771 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:50:24.911312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c789055f344bb59a86b6d4fe5cac91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6b49c60dc845c5a74f3ab5d132740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:24.919191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7c7f1969-61a2-4b2e-a89d-a3e8e464db6b tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 200 len: 1350 microversion: 2.1 time: 0.097553 Jul 16 12:50:24.919746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 123/233] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:24 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:25.397990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:25.398535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:25.411131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:25.411131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:25.411131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:25.411131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:25.540115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:25.550337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a829a837-b93e-487c-9a68-fdd9743a8ab9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.155373 Jul 16 12:50:25.551006 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 111/234] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:25 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:25.935487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:25.936230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:25.943083 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:25.943557 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:25.944313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:25.944741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:25.958871 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] HTTP exception thrown: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Request method failure captured: Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 HTTP/1.1 Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO-5guKiz-wBPpcrLusgaCr5pGCtX752QIUhza2EDoG3uwQ_nTkaMX3rY2NenevT2pDE6wxxCuTP-rmdaTwbS1h2beEUCA5x_nC8gTj1-jClxLhAXnHMNPfI9H0b7mGmFysrc-Ng1ei2swht_MYQFYFIClxBALA_5m7qNDrOIcoFSg Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:50:25.963750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a6b49c60dc845c5a74f3ab5d132740d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f1c789055f344bb59a86b6d4fe5cac91 Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:25.965225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '8ebcc2eb-d39a-4f63-b230-f5123240e771'} Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:50:25.970481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:25.971826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:25.973173 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Returning 404 to user: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:50:25.973173 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-dee52141-1908-405e-99c6-75ee5bd5a074 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 404 len: 111 microversion: 2.1 time: 0.033460 Jul 16 12:50:25.973173 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 124/235] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:25 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:50:26.070979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:26.071975 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:26.078432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:26.078932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:26.079684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:26.080113 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:26.092615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] HTTP exception thrown: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Request method failure captured: Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771/os-volume_attachments HTTP/1.1 Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO-5guKiz-wBPpcrLusgaCr5pGCtX752QIUhza2EDoG3uwQ_nTkaMX3rY2NenevT2pDE6wxxCuTP-rmdaTwbS1h2beEUCA5x_nC8gTj1-jClxLhAXnHMNPfI9H0b7mGmFysrc-Ng1ei2swht_MYQFYFIClxBALA_5m7qNDrOIcoFSg Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:50:26.098064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a6b49c60dc845c5a74f3ab5d132740d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: f1c789055f344bb59a86b6d4fe5cac91 Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:26.099460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'server_id': '8ebcc2eb-d39a-4f63-b230-f5123240e771'} Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:50:26.100289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:26.101500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:26.102602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Returning 404 to user: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:50:26.102602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5538798b-ab52-4625-95ea-891737d95f74 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032470 Jul 16 12:50:26.102602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 112/236] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:50:26 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:50:26.569218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:26.569921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:26.577448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:26.577448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:26.577842 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:26.578279 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:26.707578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:26.714907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-61508420-2a30-46d8-958b-9709847cae0b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.150571 Jul 16 12:50:26.715460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 125/237] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:26 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:27.731685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:27.732226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:27.738712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:27.739156 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:27.739915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:27.740345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:27.758791 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:27.868937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:27.876920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6410703a-8777-4023-a42b-f7cd68a6903b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.149223 Jul 16 12:50:27.877508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 113/238] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:27 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:28.894112 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:28.894644 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:28.900731 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:28.901221 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:28.902069 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:28.902507 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:29.032839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:29.040429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6b0100e4-b948-48bb-9a76-19dcfa9f723c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.150794 Jul 16 12:50:29.040993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 126/239] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:28 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:30.058907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:30.059629 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:30.070851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:30.070851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:30.070851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:30.070851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:30.211358 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:30.219624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-43fcc226-e7e1-4117-8752-25acaa8db2e2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.164435 Jul 16 12:50:30.220190 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 114/240] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:30 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:30.590395 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:30.590989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:30.597621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:30.598063 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:30.598817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:30.599318 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:30.613322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] HTTP exception thrown: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Request method failure captured: Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: DELETE /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 HTTP/1.1 Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO-5guKiz-wBPpcrLusgaCr5pGCtX752QIUhza2EDoG3uwQ_nTkaMX3rY2NenevT2pDE6wxxCuTP-rmdaTwbS1h2beEUCA5x_nC8gTj1-jClxLhAXnHMNPfI9H0b7mGmFysrc-Ng1ei2swht_MYQFYFIClxBALA_5m7qNDrOIcoFSg Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:50:30.614837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a6b49c60dc845c5a74f3ab5d132740d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f1c789055f344bb59a86b6d4fe5cac91 Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.616265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '8ebcc2eb-d39a-4f63-b230-f5123240e771'} Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:50:30.617147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.618330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.619570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Returning 404 to user: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:50:30.619570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d235ec5a-f431-44bc-89c9-7d1e2501672f tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 404 len: 111 microversion: 2.1 time: 0.029658 Jul 16 12:50:30.619570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 127/241] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:50:30 2022] DELETE /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:50:30.624417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:30.625062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] [instance: 8ebcc2eb-d39a-4f63-b230-f5123240e771] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:30.631146 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:30.631595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:30.632359 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:30.632792 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:30.781127 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] HTTP exception thrown: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Request method failure captured: Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 HTTP/1.1 Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO-5guKiz-wBPpcrLusgaCr5pGCtX752QIUhza2EDoG3uwQ_nTkaMX3rY2NenevT2pDE6wxxCuTP-rmdaTwbS1h2beEUCA5x_nC8gTj1-jClxLhAXnHMNPfI9H0b7mGmFysrc-Ng1ei2swht_MYQFYFIClxBALA_5m7qNDrOIcoFSg Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:50:30.783695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5a6b49c60dc845c5a74f3ab5d132740d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5a6b49c60dc845c5a74f3ab5d132740d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 5a6b49c60dc845c5a74f3ab5d132740d Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-DeleteServersTestJSON-1392482663 Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: f1c789055f344bb59a86b6d4fe5cac91 Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-DeleteServersTestJSON-1392482663-project Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.785152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '8ebcc2eb-d39a-4f63-b230-f5123240e771'} Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:50:30.785997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. Jul 16 12:50:30.787423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:50:30.788586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] Returning 404 to user: Instance 8ebcc2eb-d39a-4f63-b230-f5123240e771 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:50:30.788586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4cc9ba8a-a753-4874-a587-04da846820a9 tempest-DeleteServersTestJSON-1392482663 tempest-DeleteServersTestJSON-1392482663-project] 10.222.0.47 "GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771" status: 404 len: 111 microversion: 2.1 time: 0.164406 Jul 16 12:50:30.788586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 115/242] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:30 2022] GET /compute/v2.1/servers/8ebcc2eb-d39a-4f63-b230-f5123240e771 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 16 12:50:31.236864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:31.237490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:31.243714 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:31.244152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:31.244916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:31.245371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:31.693606 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:31.712137 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1b260faa-0888-4393-b502-248080d098ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.479386 Jul 16 12:50:31.714554 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 128/243] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:31 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:32.730872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:32.731777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:32.739857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:32.740407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:32.741381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:32.742095 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:32.966450 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:32.975441 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4e41af99-9147-47c4-86f3-a43e339d0634 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.248506 Jul 16 12:50:32.976058 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 116/244] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:32 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:33.994491 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:33.996406 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:34.009992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:34.011774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:34.012581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:34.013016 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:34.157609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:34.165975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f4d47475-4501-4084-aa21-ab78a5fdf5fa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.177080 Jul 16 12:50:34.176961 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 129/245] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:33 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:35.188461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:35.188461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:35.191890 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:35.192888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:35.193810 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:35.194255 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:35.334241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:35.341745 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f74cf92c-e8ea-4d22-b8ad-26aee86a60ad tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.161587 Jul 16 12:50:35.342315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 117/246] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:35 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:36.361589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:36.362286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:36.368467 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:36.369330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:36.370304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:36.370624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:36.504823 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:36.512453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d1e1cdbf-787d-4cba-aaff-dc4400662acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.155419 Jul 16 12:50:36.513317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 130/247] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:36 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:37.530045 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:37.530659 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:37.537963 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:37.538419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:37.539301 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:37.539739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:37.674235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:37.682891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8c438aaf-0505-40db-8342-c3456822f215 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.156710 Jul 16 12:50:37.686618 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 118/248] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:37 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:38.699646 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:38.700284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:38.706736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:38.707180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:38.708241 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:38.708402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:38.840537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:38.849174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-07eee641-f3d2-4718-89fa-c3138f73a838 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.153390 Jul 16 12:50:38.849738 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 131/249] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:38 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:39.867419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:39.868074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:39.874683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:39.875673 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:39.876435 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:39.876864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:40.029161 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:40.038989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ca5ec5b4-fd64-46c1-9420-2d45ffab7ace tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.176029 Jul 16 12:50:40.039563 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 119/250] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:39 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:41.055641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:41.056242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:41.062271 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:41.063486 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:41.064257 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:41.064683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:41.207115 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:41.218008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ab6f68a6-e75b-4260-bc8a-0e3bdb166acd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.166232 Jul 16 12:50:41.228231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 132/251] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:41 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:42.236679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:42.237310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:42.243892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:42.244336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:42.245120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:42.245552 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:42.379534 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:42.387114 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c85f6531-bee8-45d3-a7e6-b3401eaf8e06 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.155192 Jul 16 12:50:42.387658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 120/252] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:42 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:43.404003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:43.404602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:43.411387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:43.411823 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:43.412569 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:43.412992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:43.539309 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:43.546732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c8c5839f-60f2-4881-b53a-5da69e327136 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.146500 Jul 16 12:50:43.547294 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 133/253] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:43 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:44.563443 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:44.564199 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:44.570593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:44.571040 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:44.571803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:44.572234 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:44.701770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:44.709949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ae38014f-f305-4fa8-bc23-2c57a83c0a41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.150401 Jul 16 12:50:44.710517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 121/254] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:44 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:45.727542 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:45.728065 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:45.734026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:45.735137 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:45.736095 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:45.736529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:45.860804 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:45.868144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ae10d37b-d7f1-4605-a372-cfb488199355 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.144579 Jul 16 12:50:45.868708 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 134/255] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:45 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:46.884508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:46.885145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:46.887436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=40 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:46.892447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:46.892895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:46.893692 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:46.894137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:47.022952 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:47.030343 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ef2c6f5d-7df5-4343-a4ed-e0735fb89cd0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.149675 Jul 16 12:50:47.031134 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 122/256] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:46 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:48.046321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:48.046942 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:48.049411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=46 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:48.054349 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:48.054789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:48.057379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:48.057379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:48.191832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:48.199506 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f2a602a4-5c79-4051-a721-e8455cde5409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.157084 Jul 16 12:50:48.200060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 135/257] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:48 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:49.215763 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:49.216316 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:49.223834 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:49.224289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:49.225117 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:49.225556 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:49.357081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:49.364787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6028c17d-0728-47f0-be95-cb67fb3a63ed tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.152992 Jul 16 12:50:49.365392 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 123/258] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:49 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:50.380893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:50.381526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:50.387527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:50.387977 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:50.388726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:50.389249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:50.517018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:50.524371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-990f1c70-040b-4380-a810-603f6c26c702 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.147334 Jul 16 12:50:50.524928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 136/259] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:50 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:51.541268 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:51.541871 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:51.548986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:51.549449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:51.550195 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:51.550627 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:51.680750 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:51.688897 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7701caf8-88df-431d-a98e-994995dbf165 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.151443 Jul 16 12:50:51.689497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 124/260] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:51 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:52.705736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:52.706272 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:52.712311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:52.712754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:52.713530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:52.713962 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:52.844720 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:52.852074 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8e1c5ed8-fa6e-456b-aa25-904d397d0d9e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.150246 Jul 16 12:50:52.852628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 137/261] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:52 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:53.868570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:53.869194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:53.876298 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:53.876739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:53.877512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:53.877973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:54.012943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:54.020550 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3183aa75-98fc-4994-9450-a3aa970359d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.155819 Jul 16 12:50:54.021131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 125/262] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:53 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:50:55.037609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:55.038214 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:55.044032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:55.044471 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:55.045248 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:55.045672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:55.048883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=89 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:55.174746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:55.182639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8c7e29c9-a3a6-47d8-a783-ccd094cc164e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.148696 Jul 16 12:50:55.183127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 138/263] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:55 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:56.199383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:56.199992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:56.206531 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:56.206979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:56.207725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:56.208181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:56.335193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:56.342650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a5003287-cdaf-4888-a1d3-1ef6f9ca6c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.147251 Jul 16 12:50:56.343766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 126/264] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:56 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:57.360367 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:57.360991 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:57.367058 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:57.375898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:57.375898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:57.375898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:57.513792 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:57.521317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7a61de60-087f-438a-b2e8-ab1df2299877 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.165509 Jul 16 12:50:57.522058 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 139/265] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:57 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:58.538686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:58.539430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:58.546607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:58.547060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:58.547831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:58.548278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:58.552311 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=77 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:50:58.756774 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:58.765826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2c21088b-5c6b-4fa4-bd83-636cb17878d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.230149 Jul 16 12:50:58.768675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 127/266] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:58 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:50:59.783186 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:50:59.783787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:50:59.789543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:59.789986 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:59.790732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:50:59.791160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:50:59.943120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:50:59.950734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-be7ccbe3-49cb-4225-a61d-ef91a85fedae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.171891 Jul 16 12:50:59.951296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 140/267] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:50:59 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:00.968312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:00.968842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:00.975831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:00.976292 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:00.977084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:00.977528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:01.116914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:01.125405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f591ddd9-867a-4e1d-8071-a66311dad413 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1523 microversion: 2.1 time: 0.161277 Jul 16 12:51:01.125968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 128/268] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:00 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:02.143516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:02.147171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:02.150009 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:02.150393 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:02.151144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:02.151573 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:02.289643 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:02.309339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1d6ee0b8-577e-4051-bb47-418143c386d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1503 microversion: 2.1 time: 0.159198 Jul 16 12:51:02.309339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 141/269] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:02 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:02.316478 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:02.324545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:02.324545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:02.324765 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:02.325455 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:02.326065 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:02.466883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:02.477267 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a51644af-eeab-4fdd-b02a-43a30c67ca4e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1515 microversion: 2.1 time: 0.164844 Jul 16 12:51:02.477822 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 129/270] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:02 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:04.654485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:04.655968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:04.662150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:04.662752 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:04.663519 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:04.663949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:04.696990 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lazy-loading 'flavor' on Instance uuid d120daff-ba07-423a-bfed-2b960c4d213e {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:51:04.998174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-25467926-825e-4bda-ac86-02f242de2408 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/action" status: 200 len: 32 microversion: 2.1 time: 0.348019 Jul 16 12:51:05.003292 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 142/271] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:51:04 2022] POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/action => generated 32 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:51:05.008875 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:05.009707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:05.016382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:05.016832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:05.017650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:05.018085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:05.153218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:05.161275 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b67244bf-7db6-48d6-a051-6fd748b8fbe2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.156694 Jul 16 12:51:05.162566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 130/272] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:05 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:06.180157 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:06.181963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:06.191689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:06.192310 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:06.194084 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:06.195550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:06.344136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:06.351532 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cddd8175-fb38-4501-b8de-14c5153d9736 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.176496 Jul 16 12:51:06.352093 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 143/273] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:06 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:07.369081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:07.369685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:07.376553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:07.376975 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:07.377766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:07.378185 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:07.522025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:07.530834 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-542b8c58-ef72-4835-8f33-7fc31b0a5193 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.165694 Jul 16 12:51:07.531538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 131/274] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:07 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:08.548309 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:08.548906 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:08.555151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:08.555559 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:08.556286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:08.556710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:08.704699 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:08.710143 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-687e30fb-485c-4dba-adb9-95b42424b83c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.166105 Jul 16 12:51:08.717621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 144/275] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:08 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:09.728200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:09.728798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:09.736134 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:09.736585 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:09.737383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:09.737824 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:09.890794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:09.898164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c5dcff34-daee-4ae0-b957-0a316961fce8 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.173851 Jul 16 12:51:09.898719 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 132/276] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:09 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:10.915340 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:10.916871 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:10.923840 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:10.924887 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:10.925847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:10.926434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:11.065788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:11.073403 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-62718fef-d414-4d53-b62a-45aae4198c14 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.162692 Jul 16 12:51:11.073969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 145/277] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:10 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:12.090179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:12.090820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:12.097258 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:12.097714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:12.098473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:12.098912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:12.240812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:12.251514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6e5620ef-5ae4-410e-a54e-7e4cbc028cb2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.163244 Jul 16 12:51:12.251514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 133/278] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:12 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:13.269437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:13.270616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:13.278875 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:13.280146 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:13.281717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:13.282299 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:13.459180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:13.466602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a81992a7-2408-4b6a-9751-b5f9646bbb60 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.203549 Jul 16 12:51:13.467303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 146/279] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:13 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:14.484840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:14.485494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:14.491966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:14.492415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:14.493207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:14.493651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:14.637093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:14.645216 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-61d4ee3f-9385-4cbf-ac71-51a76b51ef41 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.164941 Jul 16 12:51:14.645780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 134/280] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:14 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:15.662827 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:15.663452 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:15.670081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:15.670785 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:15.671543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:15.672193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:15.814768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:15.822494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cc5315c0-0a63-49db-9563-4ecce0e23409 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.163754 Jul 16 12:51:15.823061 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 147/281] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:15 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:16.839562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:16.840175 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:16.847331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:16.847785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:16.848549 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:16.848994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:16.974531 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:16.981933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-70ff6b80-31b2-4eff-97bb-9a02680ba38d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.146222 Jul 16 12:51:16.982500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 135/282] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:16 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:17.998642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:17.999194 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:18.005764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:18.006208 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:18.006958 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:18.007387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:18.135941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:18.144550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d9dd085f-de9e-46f3-ae67-84520f892b7a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.149779 Jul 16 12:51:18.145140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 148/283] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:17 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:19.161090 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:19.161702 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:19.163962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=28 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:19.174073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:19.174073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:19.174073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:19.174073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:19.298562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:19.306263 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6019c3c1-3d4a-4a80-8506-742da208e70f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.149018 Jul 16 12:51:19.306840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 136/284] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:19 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:20.322957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:20.323499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:20.325520 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=28 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:20.331157 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:20.331994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:20.332367 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:20.332802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:20.599638 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:20.606993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6e9040a0-9ba4-4f42-8fec-42bf7ce155af tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.288057 Jul 16 12:51:20.607550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 149/285] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:20 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:21.624174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:21.625299 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:21.631731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:21.632181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:21.632942 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:21.633419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:21.761866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:21.769861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4947def7-56f3-4595-bfb4-d0d516f15304 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.149610 Jul 16 12:51:21.770429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 137/286] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:21 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:22.787726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:22.788249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:22.794113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:22.794553 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:22.795322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:22.795717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:22.933803 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:22.941619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-205ecdec-da3f-425b-a674-12cd7fcd67d7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.157991 Jul 16 12:51:22.942181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 150/287] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:22 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:51:23.958747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:23.959352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:23.965742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:23.966184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:23.966936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:23.967367 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:24.099411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:24.107089 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6361e3c2-b889-4b8d-ae47-59c364a4a183 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.152212 Jul 16 12:51:24.107650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 138/288] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:23 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:25.124172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:25.125292 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:25.130834 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:25.131281 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:25.132033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:25.132469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:25.134998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:25.267972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:25.275348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b3448449-ed8b-449e-bea2-235d08a6b825 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.154972 Jul 16 12:51:25.275909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 151/289] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:25 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:26.293592 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:26.294741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:26.302536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:26.305972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:26.305972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:26.305972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:26.440304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:26.447874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-36c5ee62-8542-44f9-88b3-0c8ea8d9300d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.159031 Jul 16 12:51:26.448451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 139/290] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:26 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:27.465217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:27.465842 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:27.472801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.473282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.474038 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.474477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.608285 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:27.616026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-351b74d6-73c3-40fc-aa2a-9f249407fb1c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1501 microversion: 2.1 time: 0.154984 Jul 16 12:51:27.616691 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 152/291] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:27 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:27.635646 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c15bf151-40a8-428a-afe8-a69d38132e97"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:27.636691 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:27.644532 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.660344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.660344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.660344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.682728 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] HTTP exception thrown: Cannot 'attach_volume' instance d120daff-ba07-423a-bfed-2b960c4d213e while it is in vm_state rescued Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Request method failure captured: Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/os-volume_attachments HTTP/1.1 Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 74 Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAgQ6BYa-iX_hNve8Uc-CRe2aYeOgmDm9JDPJTlq7hkROymxYhIgaGSFyhCoU6Mpn7e_x5tR8kbL6pj7P6_jm7hOCGVtuxQO52nLx9tQJ5CbQOtkIqzWVarD-VaE0opcGZG6M-p6xJipLr3uOCY0BbVVxmpXWi37xxME__L6ta2VE Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:51:27.684347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6e8a673b65b64fbc916da4ce4cdc9f81", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: f1c9a7f942c541a287da38a894f1d1f9 Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {"volumeAttachment": {"volumeId": "c15bf151-40a8-428a-afe8-a69d38132e97"}} Jul 16 12:51:27.685916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Cannot 'attach_volume' instance d120daff-ba07-423a-bfed-2b960c4d213e while it is in vm_state rescued Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'server_id': 'd120daff-ba07-423a-bfed-2b960c4d213e', 'body': {'volumeAttachment': {'volumeId': 'c15bf151-40a8-428a-afe8-a69d38132e97'}}} Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d120daff-ba07-423a-bfed-2b960c4d213e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:51:27.686819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d120daff-ba07-423a-bfed-2b960c4d213e while it is in vm_state rescued Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:51:27.688844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d120daff-ba07-423a-bfed-2b960c4d213e while it is in vm_state rescued Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Returning 409 to user: Cannot 'attach_volume' instance d120daff-ba07-423a-bfed-2b960c4d213e while it is in vm_state rescued {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8aebc3ad-1171-42d6-9f16-2c3b9350c249 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054259 Jul 16 12:51:27.690101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 140/292] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:51:27 2022] POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 16 12:51:27.695721 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:27.696245 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:27.702664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.703649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.704489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.704920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.871468 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e4c20f66-0990-46fb-8233-208d66d818a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/action" status: 202 len: 0 microversion: 2.1 time: 0.179342 Jul 16 12:51:27.874469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 153/293] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:51:27 2022] POST /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:51:27.881291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:27.882002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:27.888168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.888623 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:27.889455 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:27.889893 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:28.023597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:28.031821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bf85e48e-4c2f-42c4-99a2-1c7140eed559 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1509 microversion: 2.1 time: 0.153709 Jul 16 12:51:28.032452 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 141/294] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:27 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:29.051762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:29.053057 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:29.059781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:29.060287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:29.061061 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:29.061762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:29.194654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:29.202384 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4abc443a-f1f6-4a1d-8301-8ed1a9d9d6d9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1509 microversion: 2.1 time: 0.155805 Jul 16 12:51:29.202947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 154/295] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:29 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:30.219833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:30.221415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:30.227866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:30.228312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:30.229354 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:30.229802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:30.234642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=88 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:30.380066 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:30.389088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3ee8f78e-779a-4c35-8b77-2763663550dd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1509 microversion: 2.1 time: 0.173003 Jul 16 12:51:30.390601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 142/296] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:30 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:31.407150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:31.408485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:31.415014 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:31.415555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:31.416394 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:31.416909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:31.556660 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:31.565796 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-614dd562-fce8-4537-8fca-39f539701023 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1509 microversion: 2.1 time: 0.162648 Jul 16 12:51:31.566369 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 155/297] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:31 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:32.588318 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:32.590029 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:32.600380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:32.600891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:32.601899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:32.602573 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:32.748413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:32.756599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3558c684-7adf-43c5-97da-0b1432a697cf tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1509 microversion: 2.1 time: 0.177037 Jul 16 12:51:32.757186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 143/298] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:32 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:33.774172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:33.774708 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:33.780670 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:33.781162 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:33.781919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:33.783256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:33.911079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:33.918517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7c4022a1-8ba5-4296-8aab-fa16570dcb0e tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1515 microversion: 2.1 time: 0.148328 Jul 16 12:51:33.919165 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 156/299] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:33 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:36.643326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4e758e8a-040b-44ad-8fb6-0f05d793f637 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'create', calling method: .version_select at 0x7f6cf907ce50>, body: {"keypair": {"name": "tempest-keypair-1461154313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0yFynVKGzbyps4y8lNn3tvj28XRAu9RKdhpZDw/dKmnARVlQq0EpzN7H6ee4Cu0VSQzK11RW6Ehp1j14QIjoXTVuMNZlOFMW+Fc6JfCw30dgguCEY6t1tPNIXH23XF1A=="}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:36.676061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-4e758e8a-040b-44ad-8fb6-0f05d793f637 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:51:36.676061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-4e758e8a-040b-44ad-8fb6-0f05d793f637 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for user f1c9a7f942c541a287da38a894f1d1f9 and project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:51:36.748776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4e758e8a-040b-44ad-8fb6-0f05d793f637 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109270 Jul 16 12:51:36.749437 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 144/300] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:51:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:51:39.156690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1166067477", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75d58424-1eb7-487d-b17b-bf9f6568128d"}], "security_groups": [{"name": "tempest-securitygroup--485988375"}], "key_name": "tempest-keypair-1461154313", "user_data": "}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:39.267307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] validate_networks() for [('75d58424-1eb7-487d-b17b-bf9f6568128d', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:51:39.657065 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:51:39.657856 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:51:39.659290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:51:39.659717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:51:39.660633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:51:39.670470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:39.670921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:39.671749 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:39.672184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:39.690205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:51:39.695014 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Getting quotas for user f1c9a7f942c541a287da38a894f1d1f9 and project 6e8a673b65b64fbc916da4ce4cdc9f81. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:51:39.706803 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:51:39.709153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:51:39.892468 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8bef2a90-2bfd-42bc-a2fd-350c66207d28 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.739959 Jul 16 12:51:39.895997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 157/301] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:51:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:51:39.904944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a8b8ec90-8e2c-4532-83ba-e8a764d57eb7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:39.905661 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a8b8ec90-8e2c-4532-83ba-e8a764d57eb7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:39.962222 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a8b8ec90-8e2c-4532-83ba-e8a764d57eb7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:39.969725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a8b8ec90-8e2c-4532-83ba-e8a764d57eb7 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1246 microversion: 2.1 time: 0.068847 Jul 16 12:51:39.970447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 145/302] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:39 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:40.986656 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:40.987277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:40.993374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:40.993824 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:40.994689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:40.995182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:41.059182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:41.067128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bf3dd3ba-d7f6-4f5a-8417-ed6f1692354d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1250 microversion: 2.1 time: 0.084440 Jul 16 12:51:41.067620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 158/303] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:40 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:42.083738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:42.084449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:42.091070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:42.095192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:42.095192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:42.095192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:42.192072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:42.199704 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-28d81ed4-7f76-43e9-8fc6-ad091e51631b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1306 microversion: 2.1 time: 0.119964 Jul 16 12:51:42.200267 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 146/304] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:42 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1306 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:43.221063 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:43.222333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:43.228330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:43.228771 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:43.229568 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:43.229998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:43.433692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:43.444369 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-59b62f15-de51-4a60-93c2-fb891ccac3ae tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.226834 Jul 16 12:51:43.448719 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 159/305] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:43 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:43.727653 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-1fe26165-7444-470e-8015-be71ef576ab6 req-d1b48a34-74b4-4076-bfb7-043d89fe0e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02979a6-4ccd-43dc-8b42-b36688cc13e1", "tag": "13daf266-af42-46b2-bd78-b769f2736bda"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:43.738912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-1fe26165-7444-470e-8015-be71ef576ab6 req-d1b48a34-74b4-4076-bfb7-043d89fe0e3c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:43.739347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-1fe26165-7444-470e-8015-be71ef576ab6 req-d1b48a34-74b4-4076-bfb7-043d89fe0e3c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:43.750833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-1fe26165-7444-470e-8015-be71ef576ab6 req-d1b48a34-74b4-4076-bfb7-043d89fe0e3c service nova] Creating event network-changed:13daf266-af42-46b2-bd78-b769f2736bda for instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 on hv-cinder-83697 Jul 16 12:51:43.757723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-1fe26165-7444-470e-8015-be71ef576ab6 req-d1b48a34-74b4-4076-bfb7-043d89fe0e3c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037267 Jul 16 12:51:43.758818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 147/306] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:51:44.465339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:44.466590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:44.486158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:44.486587 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:44.487661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:44.488272 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:45.068236 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:45.075946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0d6c8184-ac88-4acc-a727-6cdaabad9ec2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.614332 Jul 16 12:51:45.076512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 160/307] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:44 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:46.093842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:46.094539 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:46.101326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:46.101774 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:46.102555 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:46.102989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:46.230746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:46.240145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-78971b93-36e1-4e85-a2e9-89d838bb4ce6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.149953 Jul 16 12:51:46.240145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 148/308] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:46 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:47.256752 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:47.257397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:47.263416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:47.263866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:47.264623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:47.265081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:47.426479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:47.433823 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-19fad191-dec6-4282-93a7-1ae663fc77a4 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.181658 Jul 16 12:51:47.434382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 161/309] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:47 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:48.451184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:48.451788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:48.459745 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:48.460190 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:48.460952 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:48.461593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:48.663373 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:48.671470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-399e5f50-e727-4560-bc66-d24d7e38a861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.223992 Jul 16 12:51:48.672056 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 149/310] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:48 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:49.689448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:49.691337 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:49.697011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:49.698857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:49.699510 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:49.700555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:49.701305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:49.701927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:49.904717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:49.926006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-adba93b0-52be-41dd-902d-5ad4bc8cfb75 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.240776 Jul 16 12:51:49.926589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 162/311] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:49 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:50.655313 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-e8056411-c5ec-4c35-893a-415ca302d274 req-e8128660-53b8-4caf-a783-4862693c3655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02979a6-4ccd-43dc-8b42-b36688cc13e1", "name": "network-vif-plugged", "status": "completed", "tag": "13daf266-af42-46b2-bd78-b769f2736bda"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:50.659584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:50.660456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:50.670448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e8056411-c5ec-4c35-893a-415ca302d274 req-e8128660-53b8-4caf-a783-4862693c3655 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:50.672584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e8056411-c5ec-4c35-893a-415ca302d274 req-e8128660-53b8-4caf-a783-4862693c3655 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:50.693071 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-e8056411-c5ec-4c35-893a-415ca302d274 req-e8128660-53b8-4caf-a783-4862693c3655 service nova] Creating event network-vif-plugged:13daf266-af42-46b2-bd78-b769f2736bda for instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 on hv-cinder-83697 Jul 16 12:51:50.703145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-e8056411-c5ec-4c35-893a-415ca302d274 req-e8128660-53b8-4caf-a783-4862693c3655 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051415 Jul 16 12:51:50.704300 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 150/312] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:51:50.945386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:50.955665 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:50.955665 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:50.959351 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:50.960120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:50.962206 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:50.963069 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:51.198950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:51.212796 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4adb7174-6eba-46ad-a4a0-f8500c03eb37 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.273432 Jul 16 12:51:51.213342 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 163/313] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:50 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:52.232108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:52.232940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:52.243491 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:52.243937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:52.245197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:52.245633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:52.510137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:52.526538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dd75dbba-2a7d-4fa5-9ecb-ed32d59fc3fd tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1371 microversion: 2.1 time: 0.298795 Jul 16 12:51:52.527646 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 151/314] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:52 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:53.545659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:53.546855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:53.556587 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:53.557346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:53.558691 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:53.559302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:53.626763 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-370522914", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:53.688480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] validate_networks() for None {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:51:53.749269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:53.757499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4eb8e5c8-f1c0-4e20-b5b7-c4d52c0f0a77 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1565 microversion: 2.1 time: 0.217587 Jul 16 12:51:53.758078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 164/315] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:53 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:53.774668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:53.775168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:53.781150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:53.781588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:53.782348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:53.782777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:53.866366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-23120a3f-63c9-4f42-be76-9a1e7a8a17a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095975 Jul 16 12:51:53.867117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 165/316] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:51:53 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:51:54.057198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:51:54.057619 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:51:54.058128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:51:54.059580 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:51:54.060191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:51:54.072621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:54.073105 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:54.073916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:54.074355 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:54.093492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Getting quotas for project 67a506c215d945909c3fb7dd7f9290ba. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:51:54.097803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Getting quotas for user 7b331f1fb94c4f17af15ddac69ab57ab and project 67a506c215d945909c3fb7dd7f9290ba. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:51:54.111902 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:51:54.115272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:51:54.228982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-56566d47-4656-4a9c-8d72-4e3b03c59b00 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606979 Jul 16 12:51:54.232571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 152/317] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 16 12:51:54.249343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4e3cfe2a-8602-4cca-aae6-644999022a82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:54.250466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4e3cfe2a-8602-4cca-aae6-644999022a82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:54.388328 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4e3cfe2a-8602-4cca-aae6-644999022a82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:54.403172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4e3cfe2a-8602-4cca-aae6-644999022a82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1214 microversion: 2.1 time: 0.154853 Jul 16 12:51:54.403172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 166/318] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:54 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:55.242831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-2cea20a1-a500-4744-9a16-c053445f98c9 req-528599e6-c79b-4734-b7e4-9f95480d435a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02979a6-4ccd-43dc-8b42-b36688cc13e1", "tag": "13daf266-af42-46b2-bd78-b769f2736bda"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:51:55.254904 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-2cea20a1-a500-4744-9a16-c053445f98c9 req-528599e6-c79b-4734-b7e4-9f95480d435a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:55.255627 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-2cea20a1-a500-4744-9a16-c053445f98c9 req-528599e6-c79b-4734-b7e4-9f95480d435a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:55.268681 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-2cea20a1-a500-4744-9a16-c053445f98c9 req-528599e6-c79b-4734-b7e4-9f95480d435a service nova] Creating event network-changed:13daf266-af42-46b2-bd78-b769f2736bda for instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 on hv-cinder-83697 Jul 16 12:51:55.275954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-2cea20a1-a500-4744-9a16-c053445f98c9 req-528599e6-c79b-4734-b7e4-9f95480d435a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036657 Jul 16 12:51:55.277345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 153/319] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:51:55.414544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-73cd9435-5c4e-4846-a792-b07a3c105be7 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:55.416405 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-73cd9435-5c4e-4846-a792-b07a3c105be7 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:55.506742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-73cd9435-5c4e-4846-a792-b07a3c105be7 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:55.516682 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-73cd9435-5c4e-4846-a792-b07a3c105be7 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1214 microversion: 2.1 time: 0.105875 Jul 16 12:51:55.536156 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 167/320] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:55 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:56.539616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:56.541032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:56.567088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:56.567687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:56.571073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:56.571735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:56.651567 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:56.664375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bb1605d6-8715-48d4-ade1-62b0fbbda42d tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1266 microversion: 2.1 time: 0.131721 Jul 16 12:51:56.664968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 154/321] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:56 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:57.682101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:57.682715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:57.689873 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:57.690543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:57.695002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:57.695002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:57.699202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:51:57.780499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:57.788772 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5c8cc845-df69-49c9-811c-f7083210a59f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1272 microversion: 2.1 time: 0.110235 Jul 16 12:51:57.789724 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 168/322] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:57 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:51:58.808367 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:51:58.808984 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:51:58.847637 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:58.848323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:58.861148 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:51:58.864184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:51:59.196836 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:51:59.205291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3f400a53-257f-4991-b74e-89064e63d422 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.402330 Jul 16 12:51:59.208379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 155/323] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:51:58 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:00.034828 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-333711d0-9404-4e41-be98-99d25f7f46dc req-c8374ed6-db56-4a58-81cc-8f7b3047cbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e32e2d-f87c-4dcf-8dd4-431831b2eb6f", "tag": "76a35b1e-9c60-40d7-a688-eebfaa3bc188"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:00.062138 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-333711d0-9404-4e41-be98-99d25f7f46dc req-c8374ed6-db56-4a58-81cc-8f7b3047cbc8 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:00.071190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-333711d0-9404-4e41-be98-99d25f7f46dc req-c8374ed6-db56-4a58-81cc-8f7b3047cbc8 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:00.098024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-333711d0-9404-4e41-be98-99d25f7f46dc req-c8374ed6-db56-4a58-81cc-8f7b3047cbc8 service nova] Creating event network-changed:76a35b1e-9c60-40d7-a688-eebfaa3bc188 for instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f on hv-cinder-83697 Jul 16 12:52:00.102065 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-333711d0-9404-4e41-be98-99d25f7f46dc req-c8374ed6-db56-4a58-81cc-8f7b3047cbc8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080909 Jul 16 12:52:00.104398 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 169/324] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:00.229713 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:00.229713 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:00.238179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:00.238649 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:00.239421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:00.239857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:00.511572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:00.520003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=60 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:00.522917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2ca9bd0d-4a66-4bea-b198-4bd3c53e100f tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.301566 Jul 16 12:52:00.524934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 156/325] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:00 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:01.541483 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:01.542190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:01.550514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:01.551211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:01.551986 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:01.552422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:01.686013 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:01.694163 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-631a1bd9-15b0-4349-8832-0109121ae797 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.156923 Jul 16 12:52:01.694723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 170/326] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:01 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:02.710269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:02.711538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:02.718571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:02.719289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:02.720321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:02.721072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:02.863615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:02.871760 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-63605aa6-780e-4c0e-90d5-1918c6de93eb tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.165648 Jul 16 12:52:02.872989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 157/327] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:02 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:03.889717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:03.890972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:03.898402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:03.899188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:03.900070 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:03.900590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:04.119183 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:04.124762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0a15693c-1fde-4b66-961f-51591d9e995e tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.238981 Jul 16 12:52:04.129908 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 171/328] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:03 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:05.146745 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:05.147955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:05.150469 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:05.151137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:05.156680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:05.157218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:05.158027 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:05.158468 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:05.297166 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:05.305875 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a6b9d6e8-1f30-46fe-9e34-4b391305ca09 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.163743 Jul 16 12:52:05.306443 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 158/329] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:05 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:06.326897 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:06.328226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:06.330719 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=4 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:06.336807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:06.337424 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:06.339265 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:06.339802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:06.510484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:06.519223 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-24ebc8b1-607e-4b46-87b6-2257ad95ae82 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.198583 Jul 16 12:52:06.520614 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 172/330] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:06 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:06.571309 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-01696771-5dd3-491d-8979-d316772462b1 req-e75854e1-0279-4ab8-93e1-af3615b81139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e32e2d-f87c-4dcf-8dd4-431831b2eb6f", "name": "network-vif-plugged", "status": "completed", "tag": "76a35b1e-9c60-40d7-a688-eebfaa3bc188"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:06.583313 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-01696771-5dd3-491d-8979-d316772462b1 req-e75854e1-0279-4ab8-93e1-af3615b81139 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:06.583985 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-01696771-5dd3-491d-8979-d316772462b1 req-e75854e1-0279-4ab8-93e1-af3615b81139 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:06.595136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-01696771-5dd3-491d-8979-d316772462b1 req-e75854e1-0279-4ab8-93e1-af3615b81139 service nova] Creating event network-vif-plugged:76a35b1e-9c60-40d7-a688-eebfaa3bc188 for instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f on hv-cinder-83697 Jul 16 12:52:06.601353 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-01696771-5dd3-491d-8979-d316772462b1 req-e75854e1-0279-4ab8-93e1-af3615b81139 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034674 Jul 16 12:52:06.602335 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 159/331] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:07.536412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:07.537030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:07.543349 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:07.544132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:07.544544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:07.545396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:07.712607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:07.725238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1b23c3f3-7ec9-4681-9179-8998e7e0eec0 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.192982 Jul 16 12:52:07.725825 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 173/332] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:07 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:08.744116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:08.744715 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:08.750831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:08.751275 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:08.752559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:08.752985 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:08.882286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:08.890508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-51838488-4124-41b4-8df5-ddf2a467b28a tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1314 microversion: 2.1 time: 0.151195 Jul 16 12:52:08.891160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 160/333] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:08 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:09.908508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:09.909322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:09.915467 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:09.916196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:09.917889 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:09.918338 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:10.084776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:10.092812 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2892a049-a934-44c8-8daf-eed6798f7e78 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1463 microversion: 2.1 time: 0.188941 Jul 16 12:52:10.093571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 174/334] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:09 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:10.140802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:10.146393 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:10.160109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:10.161228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:10.162337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:10.162830 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:10.195533 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:52:10.553125 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-10ddb731-c462-46ff-a7c0-0c3eed260551 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "DELETE /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 204 len: 0 microversion: 2.1 time: 0.418889 Jul 16 12:52:10.553125 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 161/335] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:52:10 2022] DELETE /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 16 12:52:10.561841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:10.562476 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:10.570030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:10.570488 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:10.571364 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:10.572417 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:10.728920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:10.739586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-98e949ee-a053-46a7-b2ab-9b4172480905 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1469 microversion: 2.1 time: 0.181501 Jul 16 12:52:10.740175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 175/336] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:10 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:11.757459 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:11.758167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:11.780115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:11.780854 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:11.781877 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:11.782314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:11.953442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:11.961774 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4e2d25fd-a2f9-49bf-b90f-7ba0cc136071 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1469 microversion: 2.1 time: 0.208612 Jul 16 12:52:11.962342 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 162/337] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:11 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:12.980300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:12.981144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:12.992493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:12.992945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:12.993744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:12.994177 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:13.065645 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-f52ae3fd-050e-47c0-9ac7-39ea13abc8b0 req-b4f0e306-472d-489d-a14c-a19cb32e9770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e32e2d-f87c-4dcf-8dd4-431831b2eb6f", "name": "network-vif-deleted", "tag": "76a35b1e-9c60-40d7-a688-eebfaa3bc188"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:13.075033 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-f52ae3fd-050e-47c0-9ac7-39ea13abc8b0 req-b4f0e306-472d-489d-a14c-a19cb32e9770 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:13.076075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-f52ae3fd-050e-47c0-9ac7-39ea13abc8b0 req-b4f0e306-472d-489d-a14c-a19cb32e9770 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:13.088211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-f52ae3fd-050e-47c0-9ac7-39ea13abc8b0 req-b4f0e306-472d-489d-a14c-a19cb32e9770 service nova] Creating event network-vif-deleted:76a35b1e-9c60-40d7-a688-eebfaa3bc188 for instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f on hv-cinder-83697 Jul 16 12:52:13.088397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:13.094535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-f52ae3fd-050e-47c0-9ac7-39ea13abc8b0 req-b4f0e306-472d-489d-a14c-a19cb32e9770 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Jul 16 12:52:13.095717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 163/338] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:13.101769 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c1872fae-7530-4472-8734-b3fe54e63eb2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1427 microversion: 2.1 time: 0.125810 Jul 16 12:52:13.102344 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 176/339] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:12 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1427 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:13.116264 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3909aa4b-33ee-45dc-8687-cc2f705399a8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Action: 'create', calling method: .version_select at 0x7f6cf92041f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2010400740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuJmSAruUx93Nlf4ImS7I+IPvb47Go0W3jqCyh14SdVC+S5YNP2vCxVyoI6slB+oAOHU2Yux15viEk4llL0C4cQ/ywXCM88hSvOVRkpzQHG60VCkQxamuw6zCLCXdxl4w=="}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:13.132420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-3909aa4b-33ee-45dc-8687-cc2f705399a8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Getting quotas for project fa16115e6ada4f16874b4f48730bec7f. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:52:13.137207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-3909aa4b-33ee-45dc-8687-cc2f705399a8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Getting quotas for user 8171d4ef9f644866bb5747a6c31fa5cf and project fa16115e6ada4f16874b4f48730bec7f. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:52:13.239698 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3909aa4b-33ee-45dc-8687-cc2f705399a8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.128891 Jul 16 12:52:13.240311 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 164/340] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:52:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:13.292166 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-211972537", "imageRef": "ee6a4129-8f52-4fc1-b75d-ca75e9bceb44", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2010400740", "networks": [{"uuid": "3095ac26-5d1d-4dfa-bc08-51e1f0194553"}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:13.345943 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] validate_networks() for [('3095ac26-5d1d-4dfa-bc08-51e1f0194553', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:52:13.724040 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:52:13.724457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:52:13.724918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:52:13.725361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:52:13.725802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:52:13.735386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:13.735833 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:13.736622 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:13.737066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:13.753379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Getting quotas for project fa16115e6ada4f16874b4f48730bec7f. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:52:13.757853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Getting quotas for user 8171d4ef9f644866bb5747a6c31fa5cf and project fa16115e6ada4f16874b4f48730bec7f. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:52:13.769529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:52:13.772059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee6a4129-8f52-4fc1-b75d-ca75e9bceb44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:52:13.910235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-71cfe9ba-b6ec-4d26-9926-e3d091303056 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621923 Jul 16 12:52:13.910911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 177/341] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:52:13.920991 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1b9e6027-91c4-4c8a-9e8a-32f91fd7f017 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:13.926587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1b9e6027-91c4-4c8a-9e8a-32f91fd7f017 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:13.978650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1b9e6027-91c4-4c8a-9e8a-32f91fd7f017 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:13.986002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1b9e6027-91c4-4c8a-9e8a-32f91fd7f017 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1258 microversion: 2.1 time: 0.068788 Jul 16 12:52:13.986480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 165/342] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:13 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:14.121448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:14.122064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:14.128903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:14.129384 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:14.130215 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:14.130659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:14.164869 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:14.165287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:14.165737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lazy-loading 'fault' on Instance uuid 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:52:14.209370 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b331f1fb94c4f17af15ddac69ab57ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a506c215d945909c3fb7dd7f9290ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:14.216255 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-76f14a9e-0581-41f3-8d36-938bd0f78dd1 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 200 len: 1304 microversion: 2.1 time: 0.099259 Jul 16 12:52:14.217077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 178/343] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:14 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:15.003073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-342c5ddc-29f6-4557-b928-597bfaf399ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:15.003587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-342c5ddc-29f6-4557-b928-597bfaf399ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:15.056981 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-342c5ddc-29f6-4557-b928-597bfaf399ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:15.063613 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-342c5ddc-29f6-4557-b928-597bfaf399ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1258 microversion: 2.1 time: 0.064522 Jul 16 12:52:15.065688 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 166/344] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:14 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:15.237284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:15.237899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] [instance: 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:15.243864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:15.244300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:15.245066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:15.245616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:15.259731 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] HTTP exception thrown: Instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f could not be found. Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Request method failure captured: Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f HTTP/1.1 Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rRnUzIpJsoTyk5B7B6KO4eJQGyKIuvAZnY4alTpVJm7oU5LINHX1RnX-yJkcvb9aKLmC53m0hz2gJp-mGUZh8ZMiXgnTI-yvrjBR5Ys1X4fUnjTaiEXpq0gL47h24tsa3xGXEj7ZoFWkhIr4FpvntYT15s0eW4sjqdEv43eEsCNNw4 Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 67a506c215d945909c3fb7dd7f9290ba Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesNegativeTest-363180058 Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:52:15.261321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_67a506c215d945909c3fb7dd7f9290ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67a506c215d945909c3fb7dd7f9290ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/67a506c215d945909c3fb7dd7f9290ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/67a506c215d945909c3fb7dd7f9290ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesNegativeTest-363180058 Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 67a506c215d945909c3fb7dd7f9290ba Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesNegativeTest-363180058 Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesNegativeTest-363180058-project Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 7b331f1fb94c4f17af15ddac69ab57ab Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesNegativeTest-363180058-project Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f could not be found. Jul 16 12:52:15.262849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '67e32e2d-f87c-4dcf-8dd4-431831b2eb6f'} Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f could not be found. Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:52:15.263960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f could not be found. Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f could not be found. Jul 16 12:52:15.268078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:52:15.271621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] Returning 404 to user: Instance 67e32e2d-f87c-4dcf-8dd4-431831b2eb6f could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:52:15.271621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-34653790-30a2-44fd-a0f9-3503afb9dcd2 tempest-VolumesNegativeTest-363180058 tempest-VolumesNegativeTest-363180058-project] 10.222.0.47 "GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f" status: 404 len: 111 microversion: 2.1 time: 0.031504 Jul 16 12:52:15.271621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 179/345] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:15 2022] GET /compute/v2.1/servers/67e32e2d-f87c-4dcf-8dd4-431831b2eb6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:52:16.081541 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:16.082154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:16.091954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:16.092374 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:16.093178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:16.093621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:16.161194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:16.168669 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d9e4acab-c846-43f1-8aef-0741b741464e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1310 microversion: 2.1 time: 0.091168 Jul 16 12:52:16.173259 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 167/346] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:16 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:17.200572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:17.201826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:17.210250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:17.210939 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:17.212534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:17.213405 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:17.547623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:17.557864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f4b0ca39-f444-4ec4-b1c6-39f00cf9f406 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.369745 Jul 16 12:52:17.558834 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 180/347] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:17 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:18.311060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-172fbd8e-9c70-4bea-96fa-5a66ff597b42 req-9aa52d6b-7bdf-4f2f-a389-3f92c8fcc9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:18.323131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-172fbd8e-9c70-4bea-96fa-5a66ff597b42 req-9aa52d6b-7bdf-4f2f-a389-3f92c8fcc9f5 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:18.323679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-172fbd8e-9c70-4bea-96fa-5a66ff597b42 req-9aa52d6b-7bdf-4f2f-a389-3f92c8fcc9f5 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:18.336039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-172fbd8e-9c70-4bea-96fa-5a66ff597b42 req-9aa52d6b-7bdf-4f2f-a389-3f92c8fcc9f5 service nova] Creating event network-changed:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:52:18.341403 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-172fbd8e-9c70-4bea-96fa-5a66ff597b42 req-9aa52d6b-7bdf-4f2f-a389-3f92c8fcc9f5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039311 Jul 16 12:52:18.342088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 168/348] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:18.579801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:18.582381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:18.591259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:18.591768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:18.592548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:18.593585 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:18.760501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:18.770687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a81b90f7-b13f-4791-b2cc-2bfb674b12f0 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.194243 Jul 16 12:52:18.771540 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 181/349] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:18 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:19.332941 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:19.333504 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:19.339886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:19.340603 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:19.341404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:19.341844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:19.366844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-91b9d732-71f9-4f85-99e7-1835a02ea2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/ips" status: 200 len: 151 microversion: 2.20 time: 0.038556 Jul 16 12:52:19.367147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 169/350] 10.222.0.47 () {60 vars in 1288 bytes} [Sat Jul 16 12:52:19 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:52:19.791884 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:19.792581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:19.803921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:19.804367 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:19.805193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:19.805645 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:19.965781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:19.975956 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1e702130-9029-42e1-9afe-bb13b1909f58 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.191642 Jul 16 12:52:19.976581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 182/351] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:19 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:20.950341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:20.951118 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:20.958364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:20.958805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:20.959664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:20.960102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:20.983553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f3f19c3f-5b1c-491b-9725-531e910bce00 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/ips" status: 200 len: 144 microversion: 2.1 time: 0.037380 Jul 16 12:52:20.984120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 170/352] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:52:20 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:20.993697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:20.994699 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:21.005056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:21.005509 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:21.006270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:21.006700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:21.192659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:21.202480 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9a847085-7eee-4003-9497-ea39f6feb3b3 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.212520 Jul 16 12:52:21.202994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 183/353] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:20 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:22.220115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:22.220996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:22.228771 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:22.229423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:22.230358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:22.230887 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:22.231000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:22.231590 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:22.248486 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:22.248932 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:22.250613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:22.251217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:22.289120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d078280b-6cc0-477a-a79c-d3145e74973c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/ips" status: 200 len: 148 microversion: 2.1 time: 0.066898 Jul 16 12:52:22.290091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 184/354] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:52:22 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/ips => generated 148 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:22.496625 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:22.509746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9cf4d93c-3a83-466c-8fb2-f2094b856dfa tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.293717 Jul 16 12:52:22.513341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 171/355] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:22 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:22.973263 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:22.974118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:22.980619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:22.981329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:22.985936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:22.985936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:23.009760 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lazy-loading 'flavor' on Instance uuid 80af442b-e294-4d43-9279-a6ee29d6325d {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:52:23.141693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:23.531704 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:23.533227 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:23.552972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:23.553440 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:23.557882 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:23.558334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:23.744416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:23.752121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:23.762973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-404ac0db-e5ff-4273-a6bb-4886edd9da7b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.237453 Jul 16 12:52:23.772543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 172/356] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:23 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:52:23.773427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-532ce50b-fbf8-4d3d-a521-32dd9fa6d1ef tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/action" status: 202 len: 0 microversion: 2.20 time: 0.804937 Jul 16 12:52:23.774123 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 185/357] 10.222.0.47 () {62 vars in 1318 bytes} [Sat Jul 16 12:52:22 2022] POST /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/action => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:52:23.783100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:23.783822 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:23.809838 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:23.813575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:23.814021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:23.814788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:23.815401 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:23.978659 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:23.987695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:23.990018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:23.991232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9aa086f8-efa1-4d95-9900-7b6fafe65831 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.212179 Jul 16 12:52:23.991816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 173/358] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:23 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:24.264350 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 12:52:24.264567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 12:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 12:52:24.777583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:24.782281 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:24.782992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:24.785358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:24.791072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:24.798107 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:24.798107 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:24.798107 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:24.956192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:24.970435 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0369c847-bec9-4b0d-b321-6abe12a7b558 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.193483 Jul 16 12:52:24.971209 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 186/359] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:24 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:25.012188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:25.013615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:25.021363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:25.022177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:25.023309 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:25.024080 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:25.072433 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=8 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:25.373172 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:25.383643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:25.385660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:25.387069 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c780fadc-8a13-4f3a-a352-3898b108a4ae tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.381108 Jul 16 12:52:25.398528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 174/360] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:25 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:25.565221 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8185f808-94d2-4e43-8a8a-4d0a6ca96c6f"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:25.567585 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:25.575198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:25.575198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:25.575198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:25.575641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:25.761751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62a793c9-ab1c-4679-a8ba-db00e7b3582b"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:25.771194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:25.771194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:25.771194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:25.771964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:25.772403 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:33.193287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:33.821769 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-26ef8302-bff6-42d2-a08c-66b9b0ec0a5c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.260509 Jul 16 12:52:33.827694 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 187/361] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:52:25 2022] POST /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments => generated 194 bytes in 8268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:33.842187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:33.842904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:33.852034 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:33.852753 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:33.853803 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:33.854392 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:33.872612 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cebd73e2-3360-412b-84f8-53aa57eb2905 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.116985 Jul 16 12:52:33.875376 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 175/362] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:52:25 2022] POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-volume_attachments => generated 194 bytes in 8120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:52:33.897992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:33.900206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:33.914277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:33.915068 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:33.917284 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:33.918429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:34.117444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:34.126140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0f2d437d-e0fa-4e64-9bdf-6f3227874b84 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.288575 Jul 16 12:52:34.127051 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 188/363] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:33 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:34.441872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:34.451087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:34.452884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:34.454098 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5560af83-fca4-496a-bdfb-0752e847f4ab tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.579083 Jul 16 12:52:34.454664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 176/364] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:33 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:35.143945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:35.147314 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:35.152366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:35.153052 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:35.153853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:35.154294 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:35.397649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:35.405227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-508925b5-1591-49ec-ae80-66a48e2d87fd tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.265255 Jul 16 12:52:35.406072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 189/365] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:35 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:35.472016 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:35.472759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:35.480415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:35.480798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:35.482187 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:35.482808 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:35.623999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:35.633059 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:35.634698 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:35.635866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-325dee0f-7201-4b20-adc3-1ce313c6a676 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.167887 Jul 16 12:52:35.636423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 177/366] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:35 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:36.423116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:36.423913 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:36.431095 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:36.431546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:36.432348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:36.432788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:36.655164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:36.657929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:36.663337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:36.663781 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:36.664556 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:36.667471 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:36.674732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:36.687228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-186d18a4-e64c-41f5-90b4-1cdccdd9b666 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.267933 Jul 16 12:52:36.690253 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 190/367] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:36 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:36.847358 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:36.857340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:36.859435 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:36.860958 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3e3d1fa9-9e85-4c2d-b693-fd114565e487 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.209940 Jul 16 12:52:36.864322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 178/368] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:36 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:52:37.308441 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-98624ffd-5a2c-4287-ad06-e263d53fc518 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Action: 'create', calling method: .version_select at 0x7f6cf91deb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-646467689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfocmW2khs9E0MQs5/dWWOxVgtNtGVbMp39lpuifhGm5Cq/CeIf8OwEDr88wC2IAImafk+JHby1jX6FAEzL2W7W55fbQwKWFEfOpH2P4h8NXQpl/+3Zm242XboK0FfF5Q=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:37.326762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-98624ffd-5a2c-4287-ad06-e263d53fc518 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Getting quotas for project 73deeaa0bcd7498eae06c39dfc0e2e3b. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:52:37.330839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-98624ffd-5a2c-4287-ad06-e263d53fc518 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Getting quotas for user 8431eaa3717a4f798db80c9c87832273 and project 73deeaa0bcd7498eae06c39dfc0e2e3b. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:52:37.433968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-98624ffd-5a2c-4287-ad06-e263d53fc518 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.320766 Jul 16 12:52:37.434769 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 191/369] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:52:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:37.705270 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:37.705886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:37.713188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:37.713647 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:37.714429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:37.714868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:37.851314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:37.859062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b112d2c7-82f8-4ad8-ba77-579d8f735bca tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.157699 Jul 16 12:52:37.859643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 179/370] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:37 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:37.882751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:37.883390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:37.889841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:37.890293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:37.891056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:37.891488 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:38.051580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:38.059565 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:38.061079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:38.062238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cd339675-3bf4-4886-a6ea-a8b677eba2c2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.184318 Jul 16 12:52:38.062781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 192/371] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:37 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:38.875954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:38.876558 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:38.884261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:38.884794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:38.885729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:38.886163 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:39.040562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:39.048526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-14afda4b-df4c-42d9-863f-65876656d4ea tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.176456 Jul 16 12:52:39.049329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 180/372] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:38 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:39.080158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:39.080868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:39.088547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:39.089261 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:39.090036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:39.090472 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:39.235411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:39.249718 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:39.261071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:39.262367 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-861b444a-9d32-4cdd-a771-1b954f1e35b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.186239 Jul 16 12:52:39.263050 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 193/373] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:39 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:40.066686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:40.068934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:40.075669 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:40.076122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:40.076895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:40.077532 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:40.216555 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:40.226215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-63fe6399-ca00-473a-8605-4d9ad2dbba1f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.163747 Jul 16 12:52:40.231246 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 181/374] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:40 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:40.280056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:40.280666 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:40.288949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:40.289692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:40.290634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:40.291455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:40.464646 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:40.474751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:40.479338 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:40.480864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8c14233d-e806-4d6b-88f1-092274969d8a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.205042 Jul 16 12:52:40.481793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 194/375] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:40 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:40.606675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-28fa7940-864d-4524-b323-9293219156df req-54a3abde-ec18-4f2f-a6cd-ad52a918cc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "name": "network-vif-plugged", "status": "completed", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:40.618101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-28fa7940-864d-4524-b323-9293219156df req-54a3abde-ec18-4f2f-a6cd-ad52a918cc0e service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:40.618101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-28fa7940-864d-4524-b323-9293219156df req-54a3abde-ec18-4f2f-a6cd-ad52a918cc0e service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:40.628903 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-28fa7940-864d-4524-b323-9293219156df req-54a3abde-ec18-4f2f-a6cd-ad52a918cc0e service nova] Creating event network-vif-plugged:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:52:40.634540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-28fa7940-864d-4524-b323-9293219156df req-54a3abde-ec18-4f2f-a6cd-ad52a918cc0e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Jul 16 12:52:40.635156 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 182/376] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:41.243839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:41.244448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:41.250927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:41.251306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:41.252888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:41.253577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:41.409182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:41.432064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0977ea1b-b528-4f3e-8e02-478327702da8 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.192041 Jul 16 12:52:41.442562 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 195/377] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:41 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:41.499251 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:41.499957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:41.508349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:41.508996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:41.509803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:41.510241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:41.655576 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:41.664936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:41.666481 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:41.667687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fbf3fbbb-36c8-43f0-a990-3fb51fbe9c7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.172760 Jul 16 12:52:41.668215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 183/378] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:41 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:42.449176 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:42.449816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:42.456938 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:42.458528 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:42.459652 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:42.460256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:42.608055 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:42.617431 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8607958f-91ff-4f3a-a267-54107bc568ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1358 microversion: 2.1 time: 0.172067 Jul 16 12:52:42.618014 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 196/379] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:42 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:52:42.686144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:42.686752 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:42.694048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:42.694498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:42.695264 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:42.695707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:42.825954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:42.834516 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:42.835995 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:42.837153 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-44fa3cd5-bdda-415e-bfd9-fc50660c40bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.154928 Jul 16 12:52:42.837708 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 184/380] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:42 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:43.635535 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:43.636134 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:43.643450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.643908 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.645232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.645748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.781636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:43.789762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e5de6d63-bc09-470d-886b-22586fced3c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1547 microversion: 2.1 time: 0.158033 Jul 16 12:52:43.790320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 197/381] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:43 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:43.806635 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:43.807344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:43.813694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.814156 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.814914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.815340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.855269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:43.855961 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:43.862567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.863135 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.864184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.864893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.956228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:43.962494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-53a82106-dbb1-4a75-b22f-5d260ef179ab tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1547 microversion: 2.1 time: 0.159549 Jul 16 12:52:43.963075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 185/382] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:43 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:43.979364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:43.983285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:43.984281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Searching by: {'deleted': False, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f'} {{(pid=124652) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 16 12:52:43.992545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.993438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:43.994005 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:43.994438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:44.010088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:44.018067 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:44.019661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:44.022345 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-feb413b3-1e06-452f-9241-7b0b2c4e658d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.171092 Jul 16 12:52:44.022948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 198/383] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:43 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:52:44.090869 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.multi_cell_list [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124652) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 16 12:52:44.192592 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-692d0bb4-9565-4c8c-8fbe-c53c8224d0bb tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.216299 Jul 16 12:52:44.193207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 186/384] 10.222.0.47 () {58 vars in 1124 bytes} [Sat Jul 16 12:52:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:52:44.203287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:44.203899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:44.210621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:44.211066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:44.214139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:44.214139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:44.349066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:44.356469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-408c06fc-e508-4712-89f7-818f3c189a01 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1547 microversion: 2.1 time: 0.157056 Jul 16 12:52:44.357029 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 199/385] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:44 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:45.042817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:45.043423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:45.050961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:45.052098 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:45.053177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:45.053850 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:45.185503 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-dc3690b3-5471-4312-ae73-4f05311f2329 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: .version_select at 0x7f6cf8f4daf0>, body: {"keypair": {"name": "tempest-keypair-2023673006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5QVUEvYs9l6CbR92Z84waF0UjJJUm38W1ry345mfowS5pLLWuml3aXs9hg/CD7t6jMEJvHoyy5Z7AdNcGKgVPkFq70XbvopoLBJzqb4PkyldeJyb6WLSbm0WirDzQOw=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:45.199911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-dc3690b3-5471-4312-ae73-4f05311f2329 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:52:45.208040 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-dc3690b3-5471-4312-ae73-4f05311f2329 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:52:45.220643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:45.229417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:45.230969 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:45.232109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-71835bdc-411b-4a1f-9164-a2c226ae412e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.193372 Jul 16 12:52:45.232665 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 187/386] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:45 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:45.307267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-dc3690b3-5471-4312-ae73-4f05311f2329 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125999 Jul 16 12:52:45.307897 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 200/387] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:52:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:52:46.250031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:46.250632 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:46.257572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:46.258087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:46.258838 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:46.259273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:46.392550 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:46.401392 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:46.403131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:46.404468 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0173df28-1b37-4710-aad7-a522e21159b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.158350 Jul 16 12:52:46.405075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 188/388] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:46 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:47.390779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdc2d091-0b2a-4376-9ab0-5df23c92e2aa"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:47.391877 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:47.399919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:47.400363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:47.401147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:47.401577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:47.425069 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:47.426597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:47.434163 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:47.434690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:47.435554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:47.436079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:47.585575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:47.596905 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:47.598804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:47.606774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:47.610206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-64ab48d6-94fa-463d-8402-07d060a0262d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.178783 Jul 16 12:52:47.611245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 189/389] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:47 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:47.626295 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1592985613", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a354d703-6ba1-41fe-886d-bd8338eb5858"}], "security_groups": [{"name": "tempest-securitygroup--2049246320"}], "key_name": "tempest-keypair-2023673006", "user_data": "}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:47.732414 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] validate_networks() for [('a354d703-6ba1-41fe-886d-bd8338eb5858', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:52:48.121003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:52:48.121457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:52:48.121924 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:52:48.122500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:52:48.122910 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:52:48.131201 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b9a51458-ccf0-4bbf-9340-b040f022917d tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744959 Jul 16 12:52:48.131850 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 201/390] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:52:47 2022] POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:48.137057 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:48.137537 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:48.138453 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:48.138773 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:48.160044 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:52:48.164792 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:52:48.186456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:52:48.189673 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:52:48.344137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cc22bae4-d844-4713-9122-9468821a74ca tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723302 Jul 16 12:52:48.344794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 190/391] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:52:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 16 12:52:48.356841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-54c9f851-f8b6-4516-a1e4-19424de5cf40 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:48.357573 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-54c9f851-f8b6-4516-a1e4-19424de5cf40 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:48.415978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-54c9f851-f8b6-4516-a1e4-19424de5cf40 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:48.424388 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-54c9f851-f8b6-4516-a1e4-19424de5cf40 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1242 microversion: 2.1 time: 0.071760 Jul 16 12:52:48.424965 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 202/392] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:48 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:48.569683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-9ac75083-707d-45e9-80ca-b4f2a38b0021 req-fe130c4b-ce89-48e1-b205-5a61ab0f1b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "name": "network-vif-plugged", "status": "completed", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:48.583558 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-9ac75083-707d-45e9-80ca-b4f2a38b0021 req-fe130c4b-ce89-48e1-b205-5a61ab0f1b3e service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:48.584006 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-9ac75083-707d-45e9-80ca-b4f2a38b0021 req-fe130c4b-ce89-48e1-b205-5a61ab0f1b3e service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:48.594163 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-9ac75083-707d-45e9-80ca-b4f2a38b0021 req-fe130c4b-ce89-48e1-b205-5a61ab0f1b3e service nova] Creating event network-vif-plugged:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:52:48.599454 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-9ac75083-707d-45e9-80ca-b4f2a38b0021 req-fe130c4b-ce89-48e1-b205-5a61ab0f1b3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035127 Jul 16 12:52:48.600243 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 191/393] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:48.634511 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:48.635131 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:48.642599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:48.643102 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:48.643790 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:48.644219 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:48.792698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:48.800930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:48.802746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:48.803741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0c2673e6-ea01-4b64-8474-60ffb576fb2f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.173167 Jul 16 12:52:48.804284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 203/394] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:48 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:49.442996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:49.443619 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:49.449873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:49.450352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:49.452097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:49.452097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:49.516243 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:49.524852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5e263442-5759-4adc-b0a5-839419b201e0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1238 microversion: 2.1 time: 0.086964 Jul 16 12:52:49.525465 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 192/395] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:49 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:49.822852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:49.823393 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:49.829766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:49.830210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:49.830955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:49.831383 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:49.960744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:49.968618 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:49.970193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:49.971331 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d5f442a1-8cd9-46dd-bbc0-79ee25c88eb5 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.152546 Jul 16 12:52:49.971880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 204/396] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:49 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:50.542576 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:50.543119 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:50.550136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:50.550837 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:50.551641 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:50.552112 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:50.555246 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:50.620340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:50.629129 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-576413b9-78f8-4b0c-95a3-6518b4031ad4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1302 microversion: 2.1 time: 0.090369 Jul 16 12:52:50.630325 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 193/397] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:50 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:50.992017 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:50.992633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:50.999469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:50.999909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:51.000677 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:51.001161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:51.132158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:51.139935 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:51.141455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:51.142591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6e65c4ce-4c49-402a-a6cb-8d77cacb9cc2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.156297 Jul 16 12:52:51.143140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 205/398] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:50 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:51.647640 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:51.649169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:51.657193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:51.657657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:51.658435 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:51.658876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:51.724429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:51.732455 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cf9033e5-6b1e-4bc9-a1b5-1701717bc1fe tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1312 microversion: 2.1 time: 0.089190 Jul 16 12:52:51.733129 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 194/399] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:51 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:52.162026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:52.163261 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:52.170071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:52.170881 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:52.171815 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:52.172399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:52.389182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:52.405433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:52.407053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:52.408944 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d1c3ecc5-7689-4cc2-80fd-033d3d0777e0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.251886 Jul 16 12:52:52.412390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 206/400] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:52 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:52.750296 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:52.750924 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:52.758566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:52.759018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:52.759781 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:52.760216 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:52.902289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:52.914647 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f529688f-6eee-4c95-9864-d4cb4852962f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.168211 Jul 16 12:52:52.924515 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 195/401] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:52 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:53.079855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-e3b38a74-60ef-4206-89e0-d47081dad8cd req-fa4022ab-5c88-4b1d-ba34-7f2bfa93ce99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc230ed2-1599-4afc-91fb-7db62d977189", "tag": "91be992a-dc95-41be-9780-a802edcdba39"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:53.089467 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-e3b38a74-60ef-4206-89e0-d47081dad8cd req-fa4022ab-5c88-4b1d-ba34-7f2bfa93ce99 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.089980 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-e3b38a74-60ef-4206-89e0-d47081dad8cd req-fa4022ab-5c88-4b1d-ba34-7f2bfa93ce99 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.112327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-e3b38a74-60ef-4206-89e0-d47081dad8cd req-fa4022ab-5c88-4b1d-ba34-7f2bfa93ce99 service nova] Creating event network-changed:91be992a-dc95-41be-9780-a802edcdba39 for instance cc230ed2-1599-4afc-91fb-7db62d977189 on hv-cinder-83697 Jul 16 12:52:53.118802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-e3b38a74-60ef-4206-89e0-d47081dad8cd req-fa4022ab-5c88-4b1d-ba34-7f2bfa93ce99 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042433 Jul 16 12:52:53.119646 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 207/402] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:52:53.428353 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:53.428961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:53.434829 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.435271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.436023 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.436457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.572315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:53.585379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:53.585379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:53.585931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-82b2e103-fff3-4561-beef-2c6c2c9c27a8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1745 microversion: 2.20 time: 0.161317 Jul 16 12:52:53.596732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 196/403] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:53 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:53.637436 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1437e20a-afc4-446d-891f-a44a2fabf3be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:52:53.644450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1437e20a-afc4-446d-891f-a44a2fabf3be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.644891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1437e20a-afc4-446d-891f-a44a2fabf3be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.709913 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1437e20a-afc4-446d-891f-a44a2fabf3be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Going to try to stop instance {{(pid=124651) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 16 12:52:53.916983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1437e20a-afc4-446d-891f-a44a2fabf3be tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action" status: 202 len: 0 microversion: 2.1 time: 0.283572 Jul 16 12:52:53.917620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 208/404] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:52:53 2022] POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:52:53.925808 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:53.926421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:53.932692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:53.933419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:53.933778 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.934232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.935213 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.935651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.939574 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.945171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:53.945171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:53.945171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:54.148024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:54.159279 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:54.167448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-09cfa3de-7e75-4ac0-87f4-0bf812dbd60c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.238821 Jul 16 12:52:54.170363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0bcd1ff8-1f49-4398-94e7-65b7369c9d42 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.248471 Jul 16 12:52:54.170817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 209/405] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:53 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:54.181816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 197/406] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:53 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:54.604201 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:54.604806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:54.610715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:54.611167 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:54.611960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:54.612391 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:54.740317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:54.748142 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:54.749700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:54.750854 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e331ea14-711b-4141-b8e9-08fe44e4b48c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.150607 Jul 16 12:52:54.751413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 210/407] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:54 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:55.185317 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:55.185927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:55.188206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:55.189856 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:55.190494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:55.193636 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:55.194085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:55.194851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:55.195283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:55.197448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:55.197895 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:55.200750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:55.200750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:55.329024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:55.333609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:55.336417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fdec4cf6-b929-42e8-91d2-c73c9e5c8675 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.154992 Jul 16 12:52:55.337181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 198/408] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:55 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:55.342218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-08feba87-d6cb-4fef-a75b-9116586c6ab2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.156143 Jul 16 12:52:55.342772 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 211/409] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:55 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:52:55.769432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:55.770042 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:55.776398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:55.776845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:55.777638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:55.778074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:55.903656 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:55.912063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:55.913679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:55.914849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e59b169f-fbdc-44ba-acc3-1233c5df9c8b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.149294 Jul 16 12:52:55.915407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 199/410] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:55 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:56.354113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:56.354915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:56.357144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:56.362356 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:56.362609 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:56.363151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:56.363560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:56.363664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:56.363998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:56.371651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:56.404777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:56.404777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:56.404777 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:56.508968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:56.517568 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d56a7209-152f-4b49-a66a-c7720c2952ee tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.167310 Jul 16 12:52:56.518290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 212/411] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:56 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:56.518962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:56.527498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-de67e194-c71f-4b05-b450-a23b62a0ab27 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.172750 Jul 16 12:52:56.528208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 200/412] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:56 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:52:56.933201 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:56.933807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:56.940189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:56.940636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:56.941427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:56.941858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:57.071856 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:57.079641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:57.081154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:57.082291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bce91afb-91a0-4472-b504-4f5be82d9dc7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.153456 Jul 16 12:52:57.082842 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 213/413] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:56 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:57.542821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:57.543430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:57.544322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:57.544941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:57.549976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:57.553607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:57.553607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:57.553793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:57.553881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:57.553967 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:57.553967 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:57.554261 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:57.686282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:57.688249 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:57.695018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-90f527e9-0405-42a8-867b-bb1d166be371 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.154210 Jul 16 12:52:57.695715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 214/414] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:57 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:52:57.696301 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6d599bf9-516a-4249-b216-d07a95be4b0c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.156981 Jul 16 12:52:57.705753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 201/415] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:57 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:58.101616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:58.102322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:58.108312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:58.108751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:58.109526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:58.109957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:58.241133 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:58.249176 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:58.250689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:58.251836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b52f634c-6aca-49a9-8839-df3ea0b381a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.154792 Jul 16 12:52:58.252385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 215/416] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:58 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:58.711886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:58.712580 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:58.713230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:58.714518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:58.714757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=4 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:58.715431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:58.716784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=10 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:52:58.722508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:58.723298 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:58.723298 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:58.723526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:58.723906 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:58.724086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:58.724339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:58.724737 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:58.875929 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:58.884056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5b5100e9-4ada-4dd6-9777-31fda1b8adf5 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.175059 Jul 16 12:52:58.884717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 216/417] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:58 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:52:58.892735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:58.901714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1e372b60-dcfe-415e-83fc-f2ce919e133e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.193827 Jul 16 12:52:58.902282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 202/418] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:58 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:52:59.270692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:59.271305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:59.278011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:59.278460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:59.279221 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:59.279654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:59.406523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:59.414321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:59.415801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:52:59.417141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e437db51-6293-408b-b412-53d245ee42e9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.150158 Jul 16 12:52:59.417691 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 217/419] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:52:59 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:52:59.901418 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:59.902220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:59.908757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:59.913121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:59.913121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:59.913121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:59.919274 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:52:59.919890 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:52:59.926524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:59.926978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:59.927748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:52:59.928182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:52:59.932863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:00.096149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:00.109699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-55a0de60-f667-4059-badb-5eca1b6ae9e3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.211068 Jul 16 12:53:00.110852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 203/420] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:59 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:00.132327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:00.140893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-98e3b48d-1f6b-4967-8236-72ad487123a6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.225458 Jul 16 12:53:00.141498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 218/421] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:52:59 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:00.436719 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:00.437727 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:00.444235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:00.448017 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:00.448017 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:00.448017 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:00.598495 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:00.607034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:00.608740 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:00.610180 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d0223791-331a-4027-8ca2-ff651c0d86d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.177772 Jul 16 12:53:00.610804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 204/422] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:00 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:01.127649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:01.128627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:01.135516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.136036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.137212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.137847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.160269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:01.161887 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:01.170748 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.171511 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.172491 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.173326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.313530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:01.322640 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cb43b149-fdf6-42d7-82a6-97d2a11a5201 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.198819 Jul 16 12:53:01.323437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 219/423] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:01 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:01.390102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:01.399904 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-63fb18e5-8a22-495e-bb69-0a613f32646a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.245405 Jul 16 12:53:01.401950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 205/424] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:01 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:01.512048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-c4fc78a7-9ad1-4da9-9993-61312c2d3f8f req-49a82bd6-9376-4c44-b257-f0abe3f61904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc230ed2-1599-4afc-91fb-7db62d977189", "name": "network-vif-plugged", "status": "completed", "tag": "91be992a-dc95-41be-9780-a802edcdba39"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:01.521353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-c4fc78a7-9ad1-4da9-9993-61312c2d3f8f req-49a82bd6-9376-4c44-b257-f0abe3f61904 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.521797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-c4fc78a7-9ad1-4da9-9993-61312c2d3f8f req-49a82bd6-9376-4c44-b257-f0abe3f61904 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.533866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-c4fc78a7-9ad1-4da9-9993-61312c2d3f8f req-49a82bd6-9376-4c44-b257-f0abe3f61904 service nova] Creating event network-vif-plugged:91be992a-dc95-41be-9780-a802edcdba39 for instance cc230ed2-1599-4afc-91fb-7db62d977189 on hv-cinder-83697 Jul 16 12:53:01.538839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-c4fc78a7-9ad1-4da9-9993-61312c2d3f8f req-49a82bd6-9376-4c44-b257-f0abe3f61904 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033227 Jul 16 12:53:01.539669 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 220/425] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:01.629566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:01.630175 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:01.638038 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.638470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.639182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:01.639618 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:01.775001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:01.784253 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:01.790022 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:01.790022 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-65800353-1850-4dbf-8177-5f291e3542c7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.162135 Jul 16 12:53:01.790022 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 206/426] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:01 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:02.089209 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:02.089906 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:02.096146 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.096592 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.097425 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.097855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.251039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:02.259591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-65e3980c-318e-43b4-82a3-dc38ccd204e7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1593 microversion: 2.1 time: 0.175753 Jul 16 12:53:02.260660 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 221/427] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:02 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1593 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:02.340424 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:02.341145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:02.347532 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.347988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.348757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.349237 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.418022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:02.419044 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:02.433594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.433978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.436445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.436445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.501688 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:02.509926 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-711f1d68-52c2-476f-8ff4-8c1843899ab9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.173544 Jul 16 12:53:02.519579 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 207/428] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:02 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:02.596095 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:02.605091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d759296a-1cce-42a2-9163-356b6167a75b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.191607 Jul 16 12:53:02.607495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 222/429] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:02 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:02.806983 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:02.807500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:02.813799 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.814245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.815019 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:02.815448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:02.972093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:02.993187 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:02.994886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:02.996087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-08d2f225-c3d8-4885-93ec-4644f9743976 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.194377 Jul 16 12:53:03.014285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 208/430] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:02 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:03.530588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:03.531186 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:03.545418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:03.545847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:03.548473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:03.548918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:03.622810 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:03.624025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:03.630228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:03.630682 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:03.631457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:03.631890 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:03.774461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:03.777167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:03.790090 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-da4b7d9f-dc8c-4717-988e-f2386de2d640 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.170887 Jul 16 12:53:03.799974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 209/431] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:03 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:03.852176 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:03.861022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5ded410f-3636-4494-b80c-9a14120f3b47 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1368 microversion: 2.1 time: 0.337451 Jul 16 12:53:03.861629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 223/432] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:03 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:04.015176 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:04.015784 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:04.022164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:04.022616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:04.023906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:04.024338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:04.174709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:04.196642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:04.198202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:04.199753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c0af1357-4fe9-45c0-94ec-8b8de6dca028 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.188706 Jul 16 12:53:04.200482 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 210/433] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:04 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:04.809468 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:04.810513 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:04.818184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:04.819148 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:04.821290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:04.837443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:04.878347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:04.878999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:04.886153 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:04.886636 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:04.887408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:04.888033 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:04.992741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:05.001212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2e8f6702-3412-499c-a334-12cdb7ea4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.197215 Jul 16 12:53:05.005109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 224/434] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:04 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:05.032217 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:05.040688 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cdede6b3-ab2e-415b-b3ca-cf477d6513d8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1557 microversion: 2.1 time: 0.166171 Jul 16 12:53:05.041321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 211/435] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:04 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:05.057680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:05.058178 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:05.064060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:05.064507 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:05.065299 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:05.065734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:05.143167 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-800437f9-3bbf-49d7-9ba4-a44c64407f88 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089959 Jul 16 12:53:05.145166 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 225/436] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:53:05 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:05.219975 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:05.224261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:05.227803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:05.228408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:05.229227 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:05.229845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:05.342345 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-a8ee11df-8d89-4310-92a5-520d49743645 req-f3dd8e8c-2bcd-459f-bb9d-6d8b3539a1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:05.350785 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-a8ee11df-8d89-4310-92a5-520d49743645 req-f3dd8e8c-2bcd-459f-bb9d-6d8b3539a1fe service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:05.359381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-a8ee11df-8d89-4310-92a5-520d49743645 req-f3dd8e8c-2bcd-459f-bb9d-6d8b3539a1fe service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:05.384320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-a8ee11df-8d89-4310-92a5-520d49743645 req-f3dd8e8c-2bcd-459f-bb9d-6d8b3539a1fe service nova] Creating event network-changed:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:53:05.391509 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-a8ee11df-8d89-4310-92a5-520d49743645 req-f3dd8e8c-2bcd-459f-bb9d-6d8b3539a1fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053025 Jul 16 12:53:05.392268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 226/437] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:05.503110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:05.515804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:05.519877 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:05.525337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1cb90eaa-d8a1-4405-93bb-8facdfa04c34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.309261 Jul 16 12:53:05.535899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 212/438] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:05 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:06.024056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:06.025001 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:06.044008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:06.050000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:06.050000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:06.050000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:06.544648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:06.546939 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:06.564226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:06.566437 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:06.568061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:06.570857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:06.771916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:06.782988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:06.784615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:06.785961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-42d168ef-4f27-49f4-b24e-8d83cb68b49d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.246584 Jul 16 12:53:06.786963 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 213/439] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:06 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:06.822390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:06.831139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d8fec8e0-27e3-4b0c-895a-fed6ca5007f7 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.814555 Jul 16 12:53:06.844826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 227/440] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:06 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:07.412051 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-624451973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-646467689", "security_groups": [{"name": "tempest-secgroup-smoke-1339074269"}], "networks": [{"uuid": "0ca90201-e9fc-4978-9d23-73f6dbe554e9"}], "block_device_mapping_v2": [{"uuid": "4f420663-3906-4029-83b2-c57e3f9847cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:07.412713 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-34b658b9-ab1a-4d37-ad3d-2e9bddb626c4 req-33ea8a97-53b8-404b-9a68-00266fc692cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc230ed2-1599-4afc-91fb-7db62d977189", "tag": "91be992a-dc95-41be-9780-a802edcdba39"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:07.422957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-34b658b9-ab1a-4d37-ad3d-2e9bddb626c4 req-33ea8a97-53b8-404b-9a68-00266fc692cf service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:07.423400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-34b658b9-ab1a-4d37-ad3d-2e9bddb626c4 req-33ea8a97-53b8-404b-9a68-00266fc692cf service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:07.453177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-34b658b9-ab1a-4d37-ad3d-2e9bddb626c4 req-33ea8a97-53b8-404b-9a68-00266fc692cf service nova] Creating event network-changed:91be992a-dc95-41be-9780-a802edcdba39 for instance cc230ed2-1599-4afc-91fb-7db62d977189 on hv-cinder-83697 Jul 16 12:53:07.460426 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-34b658b9-ab1a-4d37-ad3d-2e9bddb626c4 req-33ea8a97-53b8-404b-9a68-00266fc692cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052018 Jul 16 12:53:07.462436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 214/441] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:07.598526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] validate_networks() for [('0ca90201-e9fc-4978-9d23-73f6dbe554e9', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:53:07.807388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:07.808795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:07.821390 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:07.835299 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:07.837257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:07.837942 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:08.146757 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:53:08.152539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:53:08.154640 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:53:08.155273 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:53:08.157145 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:53:08.171037 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:08.188113 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:08.191077 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:08.193253 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:08.196088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-24bd31d6-3dcd-42f4-b583-5fad4162c40a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.394860 Jul 16 12:53:08.198428 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:08.199629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:08.202604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 215/442] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:07 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:53:08.203104 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:08.217916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:08.218608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:08.226205 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:08.227158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:08.228261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:08.228861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:08.258446 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Getting quotas for project 73deeaa0bcd7498eae06c39dfc0e2e3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:53:08.260998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Getting quotas for user 8431eaa3717a4f798db80c9c87832273 and project 73deeaa0bcd7498eae06c39dfc0e2e3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:53:08.366360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:53:08.370576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f420663-3906-4029-83b2-c57e3f9847cc',volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:53:08.479850 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:08.492786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2dd9f566-0de9-4d14-8a82-1c0a4afce7cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.283300 Jul 16 12:53:08.503076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 216/443] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:08 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:08.969926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ea348f58-43af-40cf-aedd-ab8796d30cfc tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.561698 Jul 16 12:53:08.972630 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 228/444] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:53:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:53:08.984281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f52213cd-adbc-4fcc-8599-2ee04164c2c4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:08.985818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f52213cd-adbc-4fcc-8599-2ee04164c2c4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:09.044382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f52213cd-adbc-4fcc-8599-2ee04164c2c4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:09.052985 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f52213cd-adbc-4fcc-8599-2ee04164c2c4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1087 microversion: 2.1 time: 0.075844 Jul 16 12:53:09.053805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 217/445] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:08 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:09.223264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:09.224008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:09.237451 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:09.238015 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:09.238882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:09.239692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:09.330600 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-319255854"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:09.333675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:09.343192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:09.343987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:09.344997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:09.345548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:09.479275 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:09.479275 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:09.480105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:09.480105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-77a3c4f4-bfa2-48f8-91f2-e90359ddb7d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.216099 Jul 16 12:53:09.480105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 229/446] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:09 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:09.528702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:09.529475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:09.543743 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.network.security_group_api [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Adding security group 44c770e3-cc75-4be6-8205-59d6f4ffa238 to port c5eda2f4-415c-4056-b687-5a2cd98420ea Jul 16 12:53:09.550919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:09.551858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:09.552979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:09.553936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:09.760947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:09.772586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-631fa7a7-b1ef-449c-9053-6e86655cb558 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1722 microversion: 2.1 time: 0.263840 Jul 16 12:53:09.774570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 230/447] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:09 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:10.071852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-06058b1b-b556-4d05-ba35-0c15ba8841ad tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:10.072529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-06058b1b-b556-4d05-ba35-0c15ba8841ad tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:10.127801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-06058b1b-b556-4d05-ba35-0c15ba8841ad tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:10.135761 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-06058b1b-b556-4d05-ba35-0c15ba8841ad tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1087 microversion: 2.1 time: 0.068418 Jul 16 12:53:10.136343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 231/448] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:10 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:10.248886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8cdb7ef1-5d32-4f7b-a00b-c141223a540a tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.929829 Jul 16 12:53:10.250079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 218/449] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:53:09 2022] POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/action => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:53:10.260192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:10.263158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:10.278181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-ce550555-4475-46ed-969a-501468a1907d req-2c5024c4-3e17-4cd4-b959-6910d1547760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:10.296090 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.297774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.301756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.302655 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.308695 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ce550555-4475-46ed-969a-501468a1907d req-2c5024c4-3e17-4cd4-b959-6910d1547760 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.309554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ce550555-4475-46ed-969a-501468a1907d req-2c5024c4-3e17-4cd4-b959-6910d1547760 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.336521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-ce550555-4475-46ed-969a-501468a1907d req-2c5024c4-3e17-4cd4-b959-6910d1547760 service nova] Creating event network-changed:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:53:10.349094 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-ce550555-4475-46ed-969a-501468a1907d req-2c5024c4-3e17-4cd4-b959-6910d1547760 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079745 Jul 16 12:53:10.354714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 219/450] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:53:10.453670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:10.454823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:10.468528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.469558 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.472973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.473657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.607223 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:10.637377 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-394f5432-aadb-4ca8-810e-640e99d103ff tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1757 microversion: 2.1 time: 0.372205 Jul 16 12:53:10.637377 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 232/451] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:10 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1757 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:10.798618 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:10.803649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:10.811737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.812244 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.813172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:10.813641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:10.822581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:10.831473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:10.836751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:10.843121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cfda57a5-82da-40a8-b468-3e462789f6cb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.394592 Jul 16 12:53:10.844303 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 220/452] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:10 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:53:11.080243 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:11.094021 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9d2ba9c4-7eed-42c3-9b74-0d4f905b8124 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1699 microversion: 2.1 time: 0.304354 Jul 16 12:53:11.096353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 233/453] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:10 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1699 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:11.114451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-685d589e-fc26-478a-bec1-3d7480282330 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:11.140501 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-685d589e-fc26-478a-bec1-3d7480282330 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.146704 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-685d589e-fc26-478a-bec1-3d7480282330 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:11.152793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:11.153479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:11.167036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.167495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:11.170049 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.170049 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:11.285529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:11.298067 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7dd6d3b4-8818-4476-8854-6a8637f79022 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1137 microversion: 2.1 time: 0.149756 Jul 16 12:53:11.309198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 234/454] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:11 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1137 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:11.322508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-685d589e-fc26-478a-bec1-3d7480282330 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Going to try to start instance {{(pid=124652) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 16 12:53:11.488709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-685d589e-fc26-478a-bec1-3d7480282330 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action" status: 202 len: 0 microversion: 2.1 time: 0.379213 Jul 16 12:53:11.489757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 221/455] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:53:11 2022] POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:53:11.497928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:11.504982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:11.504982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.505339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:11.521668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.522177 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:11.708547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:11.718739 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5b9ebab9-c12b-475d-9591-292ed3146ba9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1708 microversion: 2.1 time: 0.223791 Jul 16 12:53:11.725256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 235/456] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:11 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1708 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:11.864469 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:11.865233 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:11.877976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.883321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:11.884429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:11.886669 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:12.043774 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:12.052197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:12.053749 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:12.055576 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-08a7a327-59c5-4622-b212-e0c0bdce41b4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.195456 Jul 16 12:53:12.056232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 222/457] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:11 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:12.315837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:12.316502 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:12.325397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:12.325851 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:12.326654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:12.327073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:12.437781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:12.449246 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cc924317-a901-4c97-9ef1-7e684e3c2fc3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1185 microversion: 2.1 time: 0.137209 Jul 16 12:53:12.458098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 236/458] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:12 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:12.740113 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:12.744404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:12.752723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:12.754109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:12.755336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:12.756149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:12.924563 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:12.935509 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3995fb75-1247-4933-9afd-6f0c01c1d09e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1708 microversion: 2.1 time: 0.200294 Jul 16 12:53:12.946002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 223/459] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:12 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1708 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:13.076501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:13.078335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:13.090705 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:13.092714 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:13.095209 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:13.096259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:13.360064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:13.369175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:13.370782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:13.371960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a689be94-021e-433c-b251-b8c0526f454a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.302013 Jul 16 12:53:13.372885 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 237/460] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:13 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:13.475248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:13.476765 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:13.496065 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:13.496539 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:13.497413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:13.497842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:13.765457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:13.765457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d1c03f70-8b76-4e68-b4e3-8ff702a463bd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1271 microversion: 2.1 time: 0.275424 Jul 16 12:53:13.765457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 224/461] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:13 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:13.953493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:13.954132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:13.960072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:13.961245 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:13.961782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:13.962217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:13.964836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:14.097209 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:14.105670 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5a83d025-83be-435f-ae7d-233d680b7f35 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1708 microversion: 2.1 time: 0.156109 Jul 16 12:53:14.106232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 238/462] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:13 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:14.389947 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:14.390840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:14.397221 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:14.397668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:14.399111 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:14.399549 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:14.552816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:14.567413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:14.567413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:14.567413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4d0c13f2-8746-4d9e-a4b6-b07dff532257 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.178531 Jul 16 12:53:14.569477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 225/463] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:14 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:14.765661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:14.766550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:14.788986 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:14.789546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:14.790390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:14.791055 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:15.025569 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:15.033876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8ad5687d-333d-498f-a30c-1c2832e210a1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1271 microversion: 2.1 time: 0.272494 Jul 16 12:53:15.035863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 239/464] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:14 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1271 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:15.127473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:15.139406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:15.174256 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:15.174868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:15.181633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:15.182471 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:15.345348 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:15.354177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5f63e886-55c4-4156-be7b-7eb9b85235cb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1712 microversion: 2.1 time: 0.235727 Jul 16 12:53:15.354864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 226/465] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:15 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1712 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:15.520558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-292af2b0-0e61-47d9-9bf6-e2057036d608 req-a14f9aed-f43a-4265-8fe6-fcdb076402c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:15.533017 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-292af2b0-0e61-47d9-9bf6-e2057036d608 req-a14f9aed-f43a-4265-8fe6-fcdb076402c7 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:15.533017 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-292af2b0-0e61-47d9-9bf6-e2057036d608 req-a14f9aed-f43a-4265-8fe6-fcdb076402c7 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:15.551538 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-292af2b0-0e61-47d9-9bf6-e2057036d608 req-a14f9aed-f43a-4265-8fe6-fcdb076402c7 service nova] Creating event network-changed:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 12:53:15.552854 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-292af2b0-0e61-47d9-9bf6-e2057036d608 req-a14f9aed-f43a-4265-8fe6-fcdb076402c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035889 Jul 16 12:53:15.553729 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 240/466] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:15.582719 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:15.583418 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:15.590790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:15.591492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:15.592348 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:15.592791 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:15.750605 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:15.759000 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:15.760498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:15.761799 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-572a1cd0-1c65-4537-be38-290b960471bc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1740 microversion: 2.20 time: 0.183321 Jul 16 12:53:15.762366 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 227/467] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:15 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:16.052422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:16.053154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:16.059480 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:16.059934 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:16.060696 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:16.061157 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:16.266660 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:16.274717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3c7b32a6-5200-420d-8a01-0972bab8ca63 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.226776 Jul 16 12:53:16.275284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 241/468] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:16 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:16.779751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:16.780361 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:16.787833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:16.788278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:16.789107 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:16.789555 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:16.792438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:16.922827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:16.931621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:16.933143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:16.934317 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d4e0cdcf-cb4a-47f3-a9c8-41411fe1c7d8 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1722 microversion: 2.20 time: 0.158560 Jul 16 12:53:16.934873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 228/469] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:16 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:17.292661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:17.293345 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:17.300126 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:17.300579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:17.301624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:17.302058 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:17.432335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:17.439904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0f1b0f83-13cc-4c7a-95d0-c066db77a868 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.151950 Jul 16 12:53:17.440411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 242/470] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:17 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:17.953359 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:17.953962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:17.960331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:17.961741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:17.962595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:17.963034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:18.093802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:18.101917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:18.103496 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:18.104651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0a3ed9e9-5003-4d16-8633-4d664690aff9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1722 microversion: 2.20 time: 0.155274 Jul 16 12:53:18.105231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 229/471] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:17 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:18.456240 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:18.456885 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:18.458832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:18.464215 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:18.464665 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:18.465510 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:18.465949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:18.600847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:18.609306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-97f6a209-287a-477e-8950-5754c84008fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.156917 Jul 16 12:53:18.609874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 243/472] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:18 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:19.122921 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:19.124087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:19.125911 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:19.130718 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:19.131158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:19.131905 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:19.132403 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:19.264657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:19.272530 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:19.274720 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:19.275866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a0154353-fb06-42f4-9f14-dd29ddfc803e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1722 microversion: 2.20 time: 0.156882 Jul 16 12:53:19.276422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 230/473] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:19 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:19.335316 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-220263c2-1427-4bdf-87cb-308b852a4b47 req-f2b83f0c-9ed3-476b-8b49-d61d8847599c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "name": "network-vif-unplugged", "status": "completed", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:19.343894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-220263c2-1427-4bdf-87cb-308b852a4b47 req-f2b83f0c-9ed3-476b-8b49-d61d8847599c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:19.347492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-220263c2-1427-4bdf-87cb-308b852a4b47 req-f2b83f0c-9ed3-476b-8b49-d61d8847599c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:19.355032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-220263c2-1427-4bdf-87cb-308b852a4b47 req-f2b83f0c-9ed3-476b-8b49-d61d8847599c service nova] Creating event network-vif-unplugged:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:53:19.359848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-220263c2-1427-4bdf-87cb-308b852a4b47 req-f2b83f0c-9ed3-476b-8b49-d61d8847599c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028194 Jul 16 12:53:19.360363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 244/474] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:19.626770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:19.627291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:19.633974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:19.634411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:19.635159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:19.635588 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:19.763226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:19.770783 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3a4ab488-7ebd-4355-8c32-3a8d9f28f47b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.147938 Jul 16 12:53:19.771352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 231/475] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:19 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:20.292611 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=8 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:20.296719 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:20.297445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:20.303607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:20.304050 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:20.305723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:20.307838 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:20.438804 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:20.447228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:20.448667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:20.449887 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-846cad13-1de9-40c4-a060-57a9b91ed8d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1722 microversion: 2.20 time: 0.158661 Jul 16 12:53:20.480153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 245/476] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:20 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:20.787280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:20.787799 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:20.794220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:20.794664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:20.795417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:20.795848 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:20.927779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:20.935271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2e52a6f9-fdf8-4035-ad37-e90388b27e40 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.151969 Jul 16 12:53:20.935837 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 232/477] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:20 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:21.468068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:21.468664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:21.475130 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:21.475669 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:21.476353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:21.476775 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:21.605223 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:21.613080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:21.614588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:21.615734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6706c0d9-13dd-4f66-a9cd-90814392bf7e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1665 microversion: 2.20 time: 0.151579 Jul 16 12:53:21.616278 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 246/478] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:21 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:21.633460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0e12340-66b3-4d5a-936f-f0635e87e65d"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:21.635184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:21.641173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:21.641618 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:21.642368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:21.642798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:21.952354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:21.953008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:21.958920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:21.959364 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:21.960179 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:21.960608 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:22.093029 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:22.100448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-050ccd52-e438-4c2b-8cf3-4231313c441a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.152056 Jul 16 12:53:22.105888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 247/479] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:21 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:22.599283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b5702aeb-07ef-49a3-a5e6-7bcb9d9c016e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.969776 Jul 16 12:53:22.599918 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 233/480] 10.222.0.47 () {62 vars in 1363 bytes} [Sat Jul 16 12:53:21 2022] POST /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments => generated 188 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:53:22.714080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:22.714629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:22.720868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:22.721348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:22.722098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:22.722531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:22.968005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-84f9fabe-08c2-4b94-b8e3-18e3e55d2636 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/action" status: 202 len: 0 microversion: 2.20 time: 0.258596 Jul 16 12:53:22.968770 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 248/481] 10.222.0.47 () {62 vars in 1318 bytes} [Sat Jul 16 12:53:22 2022] POST /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:53:22.976857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:22.977543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:22.984324 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:22.984775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:22.985615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:22.986171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:23.117119 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:23.117854 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:23.122349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:23.124182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:23.124633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:23.125420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:23.126400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:23.131916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:23.133466 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:23.135412 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2a849de5-29e5-4330-959c-ce7c4784c7ac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1751 microversion: 2.20 time: 0.162668 Jul 16 12:53:23.136422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 234/482] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:22 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:23.265250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:23.272785 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5f6f60ff-e16b-4452-aa04-9d114a8e220b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.159711 Jul 16 12:53:23.273763 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 249/483] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:23 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:24.155182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:24.155815 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:24.162256 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:24.162702 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:24.163454 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:24.163884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:24.290736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:24.291723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:24.301918 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:24.305303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:24.305876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:24.306996 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:24.307506 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:24.310745 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:24.312377 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:24.313699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-db8649a9-2d47-4392-9a35-0e1e6bc700f6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1751 microversion: 2.20 time: 0.162659 Jul 16 12:53:24.314265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 235/484] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:24 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:24.441374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:24.449447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-319182e4-5cfd-4282-aa4b-235c5b9c530d tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.163274 Jul 16 12:53:24.450008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 250/485] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:24 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:25.332007 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:25.332608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:25.334803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=78 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:25.339518 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:25.339965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:25.340752 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:25.341215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:25.466062 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:25.467272 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:25.474030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:25.474487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:25.475262 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:25.475710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:25.482102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:25.491078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:25.492632 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:25.494768 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b1f510fa-9ab5-4697-906f-510e502af844 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1753 microversion: 2.20 time: 0.166907 Jul 16 12:53:25.495489 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 236/486] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:25 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:25.620151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:25.628800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-356442e0-da19-479e-990d-4a039423470e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.166675 Jul 16 12:53:25.629393 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 251/487] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:25 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:26.513325 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:26.513932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:26.520701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:26.521188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:26.521949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:26.522379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:26.647034 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:26.648254 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:26.651139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:26.654378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:26.656773 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:26.657661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:26.658498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:26.658934 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:26.663312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:26.664826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:26.666852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7919594a-7438-4e73-a757-ea8dc72a4315 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.157378 Jul 16 12:53:26.672092 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 237/488] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:26 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:27.135800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:27.143378 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-754d9831-736b-4410-8f02-5c11a9619f19 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.500190 Jul 16 12:53:27.143951 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 252/489] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:26 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:27.515825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-e578e8d3-239e-433c-ab57-c562cb971245 req-e2407b04-a4f3-464f-b8b6-077770c7baf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "name": "network-vif-plugged", "status": "completed", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:27.524444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e578e8d3-239e-433c-ab57-c562cb971245 req-e2407b04-a4f3-464f-b8b6-077770c7baf5 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:27.525562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e578e8d3-239e-433c-ab57-c562cb971245 req-e2407b04-a4f3-464f-b8b6-077770c7baf5 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:27.536879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-e578e8d3-239e-433c-ab57-c562cb971245 req-e2407b04-a4f3-464f-b8b6-077770c7baf5 service nova] Creating event network-vif-plugged:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 12:53:27.547528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-e578e8d3-239e-433c-ab57-c562cb971245 req-e2407b04-a4f3-464f-b8b6-077770c7baf5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Jul 16 12:53:27.547528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 238/490] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:27.686503 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:27.687314 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:27.694005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:27.694523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:27.695347 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:27.695851 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:27.855148 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:27.871036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:27.872536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:27.873740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-75f4f657-c6a6-46f6-88aa-a0be9a50cb29 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.191639 Jul 16 12:53:27.874298 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 253/491] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:27 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:28.160132 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:28.160842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:28.167720 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:28.168165 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:28.168931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:28.169402 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:28.315848 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:28.324133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-78b9fd78-0fd2-40ac-bfca-637da01d19d3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.168064 Jul 16 12:53:28.326959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 239/492] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:28 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:28.891756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:28.892390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:28.898972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:28.899970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:28.900859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:28.901314 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:29.039545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:29.047972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:29.049485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:29.050625 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-221225ac-3ff4-4e05-a13e-df8f4d3cdae1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.162708 Jul 16 12:53:29.051170 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 254/493] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:28 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:29.342255 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:29.342874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:29.350866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:29.351320 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:29.352097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:29.353184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:29.490982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:29.499179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-90e89ab6-fbd5-4cf7-a466-5ffe2d462d78 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.160825 Jul 16 12:53:29.499742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 240/494] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:29 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:30.068626 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:30.069268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:30.076272 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:30.076713 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:30.077484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:30.077916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:30.081231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:30.216825 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:30.225289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:30.226791 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:30.228093 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6e8f8b49-70a7-4e5f-99d8-68ccbe800682 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.163198 Jul 16 12:53:30.228709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 255/495] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:30 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:30.517174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:30.517930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:30.524579 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:30.525546 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:30.526561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:30.527196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:30.687421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:30.695175 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3028ec4d-e34b-46b5-8b96-89b6dee94693 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.182311 Jul 16 12:53:30.695741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 241/496] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:30 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:31.247582 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:31.248201 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:31.254680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:31.255122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:31.255873 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:31.256304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:31.398684 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:31.409059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:31.410804 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:31.412150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6ac65876-8aed-4b7e-b3ea-fb599d06a9cd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.168602 Jul 16 12:53:31.423492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 256/497] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:31 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:31.711767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:31.712994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:31.718988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:31.719429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:31.720194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:31.720628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:31.874866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:31.877208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:31.883438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4d9dec4a-7034-4d4e-8b4e-8ea4d3dfee8b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.175486 Jul 16 12:53:31.886535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 242/498] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:31 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:32.432041 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:32.432793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:32.439232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:32.439684 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:32.440450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:32.440883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:32.584956 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:32.594539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:32.596091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:32.597312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-96542dd6-ce68-43a7-8457-56bc3bd2ddb4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.169560 Jul 16 12:53:32.601142 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 257/499] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:32 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:32.902473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:32.903169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:32.910302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:32.910743 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:32.911606 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:32.912043 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:33.053537 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:33.061796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-76f6baa0-255a-47fc-a788-a7bbf0d96859 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.163951 Jul 16 12:53:33.062367 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 243/500] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:32 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:33.617287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:33.617966 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:33.625926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:33.626907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:33.627260 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:33.627718 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:33.775511 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:33.784196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:33.786002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:33.787346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7bf89bac-35f3-4734-9d25-74ee27baea7c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.174004 Jul 16 12:53:33.787904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 258/501] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:33 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:34.079619 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:34.080480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:34.088595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:34.089414 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:34.090330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:34.091002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:34.239389 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:34.248654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9fcf4233-8d9e-4f83-a6de-848d11fd47b4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.173590 Jul 16 12:53:34.249408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 244/502] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:34 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:34.809632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:34.810316 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:34.816992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:34.817466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:34.818220 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:34.818653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:34.959249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:34.968281 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:34.969793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:34.970935 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c7238ce9-50a2-4272-889b-9466f69bfa38 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.166830 Jul 16 12:53:34.971492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 259/503] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:34 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:35.266221 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:35.266945 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:35.275982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:35.276910 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:35.277950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:35.278864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:35.423900 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:35.433119 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6e72c340-94ee-4913-961b-854b5d577505 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.170750 Jul 16 12:53:35.433622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 245/504] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:35 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:35.991523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:35.992217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:35.999362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:35.999816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:36.000590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:36.001023 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:36.135037 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:36.144164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:36.145730 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:36.146895 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-17f9cd90-171a-46d1-9946-d3a1d5e56935 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.160760 Jul 16 12:53:36.147446 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 260/505] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:35 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:36.450517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:36.451583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:36.458724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:36.459196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:36.459968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:36.460424 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:36.597357 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:36.606154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-178bcfda-a651-4167-a98a-79e8c43ba49b tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.160357 Jul 16 12:53:36.606749 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 246/506] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:36 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:37.166939 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:37.168734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:37.175416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:37.175867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:37.176636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:37.177453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:37.317799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:37.327034 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:37.328631 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:37.329906 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-401170c8-d30b-48d0-868b-ce9f9ff576dc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.168076 Jul 16 12:53:37.330894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 261/507] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:37 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:37.625793 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:37.626742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:37.632951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:37.633475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:37.635351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:37.635351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:37.780943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:37.788766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-83731f90-50c9-4428-a031-e08881f6c1ba tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.167576 Jul 16 12:53:37.794515 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 247/508] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:37 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:38.353848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:38.354549 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:38.366539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:38.366989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:38.367761 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:38.368267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:38.504177 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:38.513544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:38.515046 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:38.516212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b4205645-bdec-47bc-b4c6-d6e403597759 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.170424 Jul 16 12:53:38.516947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 262/509] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:38 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:38.807484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:38.808132 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:38.814746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:38.815202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:38.815977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:38.816416 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:38.950545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:38.957866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6e3463f9-583a-4219-a03c-bb9010053d92 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.154896 Jul 16 12:53:38.958425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 248/510] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:38 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:39.535292 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:39.535902 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:39.543469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:39.543914 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:39.544697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:39.545152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:39.682102 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:39.690564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:39.692064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:39.693252 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-46bb6910-9222-4911-8e1f-93719278011d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.161819 Jul 16 12:53:39.693813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 263/511] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:39 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:39.974071 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:39.974675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:39.981753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:39.982191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:39.982936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:39.983363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:40.115610 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:40.123036 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7a8de01e-55e4-486a-94aa-0ef913b39019 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.152771 Jul 16 12:53:40.123591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 249/512] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:39 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:40.711544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:40.712291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:40.718674 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:40.719116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:40.719870 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:40.720298 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:40.852188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:40.860566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:40.862227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:40.863363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-025d1773-a0b4-4232-a062-9cb92055a715 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.155714 Jul 16 12:53:40.863909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 264/513] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:40 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:41.138782 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:41.139384 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:41.145846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:41.146288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:41.147030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:41.147461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:41.277724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:41.285010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-237b7ac1-c06c-47bc-8cd3-53bcdfa85653 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.150116 Jul 16 12:53:41.285587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 250/514] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:41 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:41.882005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:41.882664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:41.889942 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:41.890390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:41.891152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:41.891588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:42.020452 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:42.029642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:42.031120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:42.032266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-38ed52aa-47d7-4063-9e3a-93930a712e34 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.154147 Jul 16 12:53:42.032816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 265/515] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:41 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:42.302767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:42.303369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:42.310257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:42.310697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:42.311445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:42.311874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:42.340917 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40df6a27-c622-4452-97eb-b7bc5d78b8d4"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:42.342252 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:42.348200 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:42.348646 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:42.349432 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:42.350239 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:42.445742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:42.453138 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1995137c-cf36-43f8-b895-01bfff15d1e3 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.154527 Jul 16 12:53:42.453701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 251/516] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:42 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:43.050678 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:43.051344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:43.057677 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:43.058131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:43.058897 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:43.059337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:43.189147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:43.198053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:43.199551 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:43.200707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4484a1aa-6829-4da7-8f71-ae8a6322243b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.154046 Jul 16 12:53:43.201292 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 252/517] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:43 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:53:43.469621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:43.470241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:43.476474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:43.476923 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:43.477766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:43.478203 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:43.607996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:43.615628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-60ed5a93-a001-4384-8bc5-8012d56247ca tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.149898 Jul 16 12:53:43.616194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 253/518] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:43 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:44.217973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:44.218575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:44.224577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:44.225021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:44.225802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:44.226236 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:44.355649 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:44.363838 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:44.365357 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:44.366508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-06e6d242-b17d-47eb-8ad4-d6db57b7b927 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.152410 Jul 16 12:53:44.367062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 254/519] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:44 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:53:44.632782 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:44.633477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:44.640505 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:44.640974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:44.641767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:44.642196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:44.773922 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:44.782245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e43d47fd-b25a-498d-85fa-929e6a8b1109 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.153287 Jul 16 12:53:44.784493 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 255/520] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:44 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:53:45.117445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-921d527d-6954-4c10-a99c-436f76379ba3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.780264 Jul 16 12:53:45.118055 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 266/521] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:53:42 2022] POST /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments => generated 194 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:53:45.385152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:45.385767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:45.391731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:45.392181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:45.392943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:45.393417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:45.524871 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:45.533161 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:45.534651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:45.535795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fd784a18-cb03-4a84-9808-ff21070d97ce tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.155141 Jul 16 12:53:45.536356 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 256/522] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:45 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:45.799813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:45.800428 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:45.808502 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:45.813079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:45.813079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:45.813079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:45.945947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:45.953585 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7750e3d7-8800-42ce-bc35-e3a4e1451ade tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1259 microversion: 2.1 time: 0.158138 Jul 16 12:53:45.954159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 267/523] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:45 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:46.558679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:46.558679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:46.562476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:46.562928 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:46.563690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:46.564208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:46.695426 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:46.705178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:46.706701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:46.707843 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6d457508-5c11-4561-a865-5b258728c9b9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.157450 Jul 16 12:53:46.708403 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 257/524] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:46 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:46.971099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:46.971725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:46.979042 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:46.979489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:46.980233 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:46.980661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:47.109613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:47.117193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-72276925-e2f4-46e7-b193-665e53e22a3e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1443 microversion: 2.1 time: 0.149878 Jul 16 12:53:47.117759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 268/525] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:46 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:47.133489 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:47.134218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:47.140160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:47.140494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:47.141281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:47.141718 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:47.269568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:47.277341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f24a0c12-e492-48ad-afff-88692a6ebf35 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1443 microversion: 2.1 time: 0.147498 Jul 16 12:53:47.277878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 258/526] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:47 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:47.726346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:47.726952 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:47.733371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:47.733823 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:47.734576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:47.735006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:47.903187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:47.911522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:47.913159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:47.914349 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8415fd3a-8504-4ab5-b015-956c1ce84782 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.191949 Jul 16 12:53:47.914907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 269/527] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:47 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:48.933240 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:48.933853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:48.940457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:48.940951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:48.941774 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:48.942213 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:48.956992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:49.076912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:49.085232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:49.086764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:49.088447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8010ed3d-2b3c-4176-a8d3-2ee4bb4572e4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.159285 Jul 16 12:53:49.089209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 259/528] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:48 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:49.320112 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-3dceb921-ba99-4cc8-b60a-f0d238d850b2 req-09169321-366b-4c60-8066-46f1b542b19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:49.329795 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3dceb921-ba99-4cc8-b60a-f0d238d850b2 req-09169321-366b-4c60-8066-46f1b542b19d service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:49.330238 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3dceb921-ba99-4cc8-b60a-f0d238d850b2 req-09169321-366b-4c60-8066-46f1b542b19d service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:49.342125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-3dceb921-ba99-4cc8-b60a-f0d238d850b2 req-09169321-366b-4c60-8066-46f1b542b19d service nova] Creating event network-changed:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 12:53:49.347438 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-3dceb921-ba99-4cc8-b60a-f0d238d850b2 req-09169321-366b-4c60-8066-46f1b542b19d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030997 Jul 16 12:53:49.348036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 270/529] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:50.106987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:50.107589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:50.114005 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:50.114447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:50.115198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:50.115624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:50.249322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:50.257719 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:50.269211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:50.269211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bcb05904-491b-451f-91a5-588fb8ca0fc3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.158578 Jul 16 12:53:50.269211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 260/530] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:50 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:51.280042 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:51.280737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:51.286887 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:51.287331 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:51.288080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:51.288512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:51.292443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:51.467976 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:51.476995 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:51.479440 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:51.480609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-82625fb2-f672-487b-b31c-06b16d5721f2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.205464 Jul 16 12:53:51.481441 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 271/531] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:51 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:52.499750 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:52.500293 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:52.506741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:52.507195 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:52.507956 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:52.508390 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:52.709478 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:52.718566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:52.720091 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:52.721289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ad5503da-4b74-48f0-96b2-ba1723995f3e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.225476 Jul 16 12:53:52.721847 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 261/532] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:52 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:53.676698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:53.677930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:53.685355 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:53.685885 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:53.686969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:53.687479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:53.710076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lazy-loading 'flavor' on Instance uuid d02979a6-4ccd-43dc-8b42-b36688cc13e1 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:53:53.739860 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:53.740627 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:53.748927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:53.749617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:53.750390 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:53.750825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:53.893783 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:53.902520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:53.904041 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:53.905283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-07e7f68e-2ba3-45f6-b137-51b21399411b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.169479 Jul 16 12:53:53.905837 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 262/533] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:53 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:53.910066 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-bc6f0c75-9a4e-4ad8-afb2-886b576e94e6 req-e1f43030-57e4-4781-bcdf-5c1ed041065d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "name": "network-vif-plugged", "status": "completed", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:53:53.918559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-bc6f0c75-9a4e-4ad8-afb2-886b576e94e6 req-e1f43030-57e4-4781-bcdf-5c1ed041065d service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:53.919003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-bc6f0c75-9a4e-4ad8-afb2-886b576e94e6 req-e1f43030-57e4-4781-bcdf-5c1ed041065d service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:53.929648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-bc6f0c75-9a4e-4ad8-afb2-886b576e94e6 req-e1f43030-57e4-4781-bcdf-5c1ed041065d service nova] Creating event network-vif-plugged:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:53:53.935819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-bc6f0c75-9a4e-4ad8-afb2-886b576e94e6 req-e1f43030-57e4-4781-bcdf-5c1ed041065d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028870 Jul 16 12:53:53.936430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 263/534] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:53:54.136144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-af424d52-865b-42b8-be2a-608b1aa44b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/action" status: 200 len: 32 microversion: 2.1 time: 0.464144 Jul 16 12:53:54.136738 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 272/535] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:53:53 2022] POST /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/action => generated 32 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:53:54.146312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:54.147009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:54.154234 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:54.154683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:54.155483 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:54.155917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:54.291252 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:54.299072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e65d5beb-7eca-49bf-9cba-619c6a0738ee tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.157025 Jul 16 12:53:54.299639 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 264/536] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:54 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:54.925280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:54.925989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:54.933092 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:54.933538 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:54.934289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:54.934718 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:55.068408 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:55.076656 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:55.078168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:55.079308 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2b52b0fb-73ff-4a7a-84ee-18f47f4b2abc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.159000 Jul 16 12:53:55.079865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 273/537] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:54 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:55.317022 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:55.317613 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:55.324877 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:55.325364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:55.326137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:55.326575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:55.533764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:55.541812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9d06967d-33c0-43b0-8971-ea0504a70861 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.228956 Jul 16 12:53:55.542377 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 265/538] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:55 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:56.097920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:56.098527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:56.105643 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:56.106091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:56.106845 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:56.107281 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:56.244925 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:56.253253 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:56.254751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:56.255903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e6d37fdf-aac9-468e-87e3-b2e03904fbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.161917 Jul 16 12:53:56.256475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 274/539] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:56 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:56.559755 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:56.559755 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:56.561909 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=60 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:56.566706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:56.567154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:56.567913 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:56.568345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:56.699031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:56.706933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-68697066-3ae9-4448-8101-e0623833b8f3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.152161 Jul 16 12:53:56.707493 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 266/540] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:56 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:57.273830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:57.274437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:57.277027 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=46 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:53:57.281982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:57.282429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:57.283192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:57.283624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:57.419590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:57.429065 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:57.430704 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:57.432650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e24cc80a-122b-4926-a357-bacc70c010d6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1809 microversion: 2.20 time: 0.162706 Jul 16 12:53:57.433244 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 275/541] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:57 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:57.723830 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:57.724444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:57.731657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:57.732120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:57.732890 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:57.733366 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:57.864931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:57.873091 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4fdce201-15ba-4984-b14a-359ed5533dfa tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.153104 Jul 16 12:53:57.873676 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 267/542] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:57 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:53:58.450731 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:58.451337 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:58.457671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:58.458118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:58.458907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:58.459339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:58.591476 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:58.599858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:58.601376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:58.602551 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b1d36c5c-09ee-420e-ae74-ee454551166d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1796 microversion: 2.20 time: 0.156471 Jul 16 12:53:58.603505 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 276/543] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:53:58 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:53:58.890846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:53:58.891454 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:53:58.898115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:58.898593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:58.899355 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:53:58.900561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:53:59.031754 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:53:59.036819 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c82859d2-4110-4b49-bb4f-409b51504a15 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.149779 Jul 16 12:53:59.037425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 268/544] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:53:58 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:00.055320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:00.056550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:00.062961 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:00.063407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:00.064191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:00.064627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:00.460706 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:00.469137 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-efc07fe5-fdd5-42c2-8d14-1e2fd806b49c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.417858 Jul 16 12:54:00.469705 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 277/545] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:00 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:01.487001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:01.487561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:01.494717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:01.495158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:01.495922 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:01.496331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:01.625136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:01.633002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6f0c2253-690a-46c3-91cc-c592ebe7e357 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.149911 Jul 16 12:54:01.633592 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 269/546] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:01 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:02.649977 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:02.650614 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:02.657312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:02.657784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:02.658584 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:02.659011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:02.788753 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:02.797172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-97a20094-45b3-4fa5-8a8d-249a70f9b323 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.151075 Jul 16 12:54:02.797737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 278/547] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:02 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:03.815121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:03.815721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:03.822170 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:03.823226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:03.823977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:03.824405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:03.953820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:03.961624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-135c8f8e-f5fb-459f-b27e-63c753172a1f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.150386 Jul 16 12:54:03.962190 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 270/548] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:03 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:04.979096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:04.979872 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:04.986441 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:04.986885 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:04.987639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:04.988072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:05.112796 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:05.121578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7268c1a7-fbee-4f17-a40c-f32176b4f8ef tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.146937 Jul 16 12:54:05.122144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 279/549] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:04 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:06.239528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:06.240138 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:06.246081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:06.246528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:06.247280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:06.247715 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:06.377188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:06.385510 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-09a677f7-a169-4e14-b8ff-0f640aee7f4f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.251109 Jul 16 12:54:06.386082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 271/550] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:06 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:07.401990 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:07.402602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:07.409214 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:07.409661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:07.410417 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:07.410915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:07.543482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:07.551445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-99fb0ed0-9a74-49ff-a7da-214e7f2aa598 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.153665 Jul 16 12:54:07.552011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 280/551] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:07 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:08.575431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:08.576078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:08.582420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:08.590951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:08.590951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:08.590951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:08.712539 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:08.721090 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b60dbeeb-7a52-44e2-8aa7-9045af7d853d tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.149805 Jul 16 12:54:08.721659 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 272/552] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:08 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:09.738555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:09.739187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:09.747262 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:09.747702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:09.748463 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:09.748893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:09.883683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:09.891932 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-add7df4f-302f-4bf5-9768-fad871ad9648 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.157433 Jul 16 12:54:09.892492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 281/553] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:09 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:10.912450 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:10.913096 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:10.920277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:10.920721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:10.921520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:10.921957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:11.047704 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:11.055852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d509712a-5bda-46a8-a854-c5d5685df9a9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.147371 Jul 16 12:54:11.056419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 273/554] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:10 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:12.074093 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:12.074725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:12.081159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:12.081607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:12.082363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:12.082794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:12.212680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:12.220664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0d2ed4eb-b600-498a-9127-948c2ea7e585 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.151331 Jul 16 12:54:12.221270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 282/555] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:12 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:13.237208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:13.237837 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:13.244316 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:13.245287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:13.246036 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:13.246465 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:13.598707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:13.607791 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-98fbb4d6-1878-41db-994e-73de1b75882b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.374541 Jul 16 12:54:13.608359 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 274/556] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:13 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:14.625631 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:14.626242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:14.632748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:14.633231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:14.633994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:14.634426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:14.762704 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:14.770708 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a174d14d-cf5a-466f-8827-778ee84f802f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1735 microversion: 2.1 time: 0.149025 Jul 16 12:54:14.771269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 283/557] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:14 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:15.787632 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:15.788242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:15.794876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:15.795319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:15.796075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:15.796506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:15.928147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:15.936654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d22409e8-b3ba-409c-a19f-ec5867cffcc5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1715 microversion: 2.1 time: 0.152849 Jul 16 12:54:15.937256 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 275/558] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:15 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:15.991624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:15.995706 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:15.999829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:16.000280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:16.001200 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:16.001597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:16.127792 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] HTTP exception thrown: Cannot 'detach_volume' instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 while it is in vm_state rescued Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Request method failure captured: Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments/40df6a27-c622-4452-97eb-b7bc5d78b8d4 HTTP/1.1 Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAgQ6BYa-iX_hNve8Uc-CRe2aYeOgmDm9JDPJTlq7hkROymxYhIgaGSFyhCoU6Mpn7e_x5tR8kbL6pj7P6_jm7hOCGVtuxQO52nLx9tQJ5CbQOtkIqzWVarD-VaE0opcGZG6M-p6xJipLr3uOCY0BbVVxmpXWi37xxME__L6ta2VE Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:54:16.129779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6e8a673b65b64fbc916da4ce4cdc9f81", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f1c9a7f942c541a287da38a894f1d1f9 Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:54:16.131324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Cannot 'detach_volume' instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 while it is in vm_state rescued Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'server_id': 'd02979a6-4ccd-43dc-8b42-b36688cc13e1', 'id': '40df6a27-c622-4452-97eb-b7bc5d78b8d4'} Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:54:16.132116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 while it is in vm_state rescued Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 while it is in vm_state rescued Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:54:16.133668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Returning 409 to user: Cannot 'detach_volume' instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 while it is in vm_state rescued {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:54:16.134838 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-72237366-c3a8-4935-b447-a5b027f8eb97 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments/40df6a27-c622-4452-97eb-b7bc5d78b8d4" status: 409 len: 152 microversion: 2.1 time: 0.143686 Jul 16 12:54:16.134838 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 284/559] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:54:15 2022] DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments/40df6a27-c622-4452-97eb-b7bc5d78b8d4 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 16 12:54:16.140822 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:16.141381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:16.147447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:16.147917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:16.148658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:16.149121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:16.175435 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:16.397194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e4dc57a9-14b9-4635-8880-d1b2271596f2 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "POST /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/action" status: 202 len: 0 microversion: 2.1 time: 0.260072 Jul 16 12:54:16.397992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 276/560] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:54:16 2022] POST /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:16.406317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:16.406931 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:16.413841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:16.414293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:16.415059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:16.415499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:16.551989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:16.554697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:16.562016 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c608d14f-bbf1-4acb-9676-813fbfffedd5 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1723 microversion: 2.1 time: 0.159596 Jul 16 12:54:16.562591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 285/561] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:16 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:17.580597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:17.581469 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:17.587771 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:17.588214 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:17.589494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:17.589974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:17.718225 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:17.726131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-19ab06c5-644f-48b4-843e-75c82fb453a3 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1723 microversion: 2.1 time: 0.150181 Jul 16 12:54:17.726691 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 277/562] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:17 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:18.743319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:18.743922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:18.752020 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:18.752459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:18.753243 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:18.753673 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:18.881994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:18.889950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-768e317a-d14e-4060-83dc-afc7e757c680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1723 microversion: 2.1 time: 0.150462 Jul 16 12:54:18.890510 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 286/563] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:18 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:19.908384 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:19.908986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:19.915399 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:19.915839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:19.916584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:19.917259 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:20.047505 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:20.055583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-12ee08dd-b070-4f05-afba-ca5f01ffa077 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1723 microversion: 2.1 time: 0.151030 Jul 16 12:54:20.056149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 278/564] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:19 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:21.072481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:21.073144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:21.079540 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:21.079992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:21.080747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:21.081217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:21.210440 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:21.219054 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bc5c0f15-1df4-445f-bf23-eccf420fd2ac tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1729 microversion: 2.1 time: 0.150453 Jul 16 12:54:21.219613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 287/565] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:21 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:21.235987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:21.236487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:21.242962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:21.243411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:21.244170 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:21.244608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:21.320420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-466572c1-03c3-461b-84fe-e3ba75b2ce23 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088244 Jul 16 12:54:21.321018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 279/566] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:54:21 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:54:22.251865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-57711f98-ceaf-4760-95fb-4238d4128a05 req-07dab05f-e817-4472-93d8-39fa23f58c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02979a6-4ccd-43dc-8b42-b36688cc13e1", "tag": "13daf266-af42-46b2-bd78-b769f2736bda"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:22.260462 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-57711f98-ceaf-4760-95fb-4238d4128a05 req-07dab05f-e817-4472-93d8-39fa23f58c81 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:22.261073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-57711f98-ceaf-4760-95fb-4238d4128a05 req-07dab05f-e817-4472-93d8-39fa23f58c81 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:22.272337 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-57711f98-ceaf-4760-95fb-4238d4128a05 req-07dab05f-e817-4472-93d8-39fa23f58c81 service nova] Creating event network-changed:13daf266-af42-46b2-bd78-b769f2736bda for instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 on hv-cinder-83697 Jul 16 12:54:22.279861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-57711f98-ceaf-4760-95fb-4238d4128a05 req-07dab05f-e817-4472-93d8-39fa23f58c81 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031690 Jul 16 12:54:22.280466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 288/567] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:54:24.294352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-58a3737a-0d51-4f74-91aa-9d490d34b348 req-eb71e863-711f-43e9-84d4-cbc4a23968b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02979a6-4ccd-43dc-8b42-b36688cc13e1", "tag": "13daf266-af42-46b2-bd78-b769f2736bda"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:24.302328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-58a3737a-0d51-4f74-91aa-9d490d34b348 req-eb71e863-711f-43e9-84d4-cbc4a23968b6 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:24.302770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-58a3737a-0d51-4f74-91aa-9d490d34b348 req-eb71e863-711f-43e9-84d4-cbc4a23968b6 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:24.314241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-58a3737a-0d51-4f74-91aa-9d490d34b348 req-eb71e863-711f-43e9-84d4-cbc4a23968b6 service nova] Creating event network-changed:13daf266-af42-46b2-bd78-b769f2736bda for instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 on hv-cinder-83697 Jul 16 12:54:24.319050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-58a3737a-0d51-4f74-91aa-9d490d34b348 req-eb71e863-711f-43e9-84d4-cbc4a23968b6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028968 Jul 16 12:54:24.319603 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 280/568] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:54:33.209089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=27 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:33.209837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=15 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:33.213909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:33.214964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:33.220981 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:33.221460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:33.222212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:33.222644 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:33.394690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-99bea7eb-5f7f-4bf3-86ea-1cd0027fe45c tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.186783 Jul 16 12:54:33.395825 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 289/569] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:54:33 2022] POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:33.404146 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:33.405519 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:33.408308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=30 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:33.413259 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:33.413786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:33.414553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:33.414986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:33.576024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:33.584029 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-79b8f8f6-1537-484e-81d4-214eb96f8b92 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1749 microversion: 2.1 time: 0.184151 Jul 16 12:54:33.584634 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 281/570] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:33 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:34.603927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:34.604671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:34.611421 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:34.611858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:34.612606 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:34.613052 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:34.764448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:34.773319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-da59f7ad-fdcd-4e91-9b28-cb14fc4f4745 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.174047 Jul 16 12:54:34.773893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 290/571] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:34 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:35.249257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:35.249735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:35.255835 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:35.256316 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:35.257093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:35.257528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:35.384011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lazy-loading 'services' on Instance uuid b56c8229-cd52-4255-9f93-6025d9859b44 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:54:35.681599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cd72a443-2c3c-437d-9264-3bb6b41b311f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-volume_attachments/62a793c9-ab1c-4679-a8ba-db00e7b3582b" status: 202 len: 0 microversion: 2.1 time: 0.536627 Jul 16 12:54:35.682407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 282/572] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:54:35 2022] DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-volume_attachments/62a793c9-ab1c-4679-a8ba-db00e7b3582b => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:35.791729 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:35.792343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:35.799292 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:35.799739 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:35.800501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:35.800930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:35.945435 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:35.953525 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2aab349b-09f0-447f-8b9f-cf4c69da38c7 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.165612 Jul 16 12:54:35.954374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 291/573] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:35 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:36.971862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:36.972560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:36.981013 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:36.981496 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:36.982850 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:36.983277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:37.132568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:37.140578 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f2005339-710e-41b3-aff4-744cc89a5f75 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.173465 Jul 16 12:54:37.141247 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 283/574] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:36 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:37.844744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-49d569f8-c3c6-4fe7-b607-f16cc0e340ff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:37.851169 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-49d569f8-c3c6-4fe7-b607-f16cc0e340ff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:37.851617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-49d569f8-c3c6-4fe7-b607-f16cc0e340ff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:37.873702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-49d569f8-c3c6-4fe7-b607-f16cc0e340ff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Going to try to stop instance {{(pid=124651) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 16 12:54:38.039276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-49d569f8-c3c6-4fe7-b607-f16cc0e340ff tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action" status: 202 len: 0 microversion: 2.1 time: 0.198796 Jul 16 12:54:38.039868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 292/575] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:54:37 2022] POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:38.048135 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:38.048709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:38.055410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:38.055867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:38.056641 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:38.057096 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:38.158642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:38.159347 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:38.165538 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:38.166218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:38.167169 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:38.167606 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:38.192217 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:38.209191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d8ecf5a7-0120-49ce-a20f-54f686fd0bac tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.165003 Jul 16 12:54:38.216802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 284/576] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:38 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:38.322330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:38.330329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-20fa2367-50dc-499f-b697-614b088fd151 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.176042 Jul 16 12:54:38.330890 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 293/577] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:38 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:39.232266 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:39.232900 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:39.239428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:39.239874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:39.240629 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:39.241089 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:39.347343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:39.348073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:39.354726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:39.355181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:39.355949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:39.356388 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:39.369593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:39.377684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ca93f718-c013-412b-b3bd-eb05ae2014e3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.149595 Jul 16 12:54:39.378254 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 285/578] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:39 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:39.497070 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:39.505527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-af58cfed-bd7d-41e3-a6a6-53a063e7cfba tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.162015 Jul 16 12:54:39.506573 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 294/579] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:39 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:40.395301 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:40.395910 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:40.402378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:40.402826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:40.403581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:40.404154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:40.523554 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:40.529409 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:40.530811 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:40.531258 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:40.532018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:40.532446 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:40.534423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:40.541865 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e9d59524-d6fd-4b42-8fb6-a7fefe3ae5bf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.150469 Jul 16 12:54:40.542512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 286/580] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:40 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:40.674034 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:40.682122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7f3283fb-b81d-40da-94f3-dc0f31bdc023 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.162499 Jul 16 12:54:40.682685 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 295/581] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:40 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:41.559853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:41.560395 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:41.566789 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:41.567228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:41.567977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:41.568400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:41.697274 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:41.699953 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:41.700571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:41.705615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-579dcb50-93b5-4dbd-948f-f445ee35a0e1 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.149662 Jul 16 12:54:41.706244 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 287/582] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:41 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:41.707705 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:41.708154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:41.708915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:41.709381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:41.853322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:41.861229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-56059ad7-7f02-490c-9e27-379d8cd94e4b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.165444 Jul 16 12:54:41.861792 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 296/583] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:41 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:42.723211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:42.723838 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:42.730212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:42.730662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:42.731418 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:42.732642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:42.858271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:42.865635 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-31a48b37-8c11-442c-8112-9d883f25e0a8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.146265 Jul 16 12:54:42.866212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 288/584] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:42 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:42.878406 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:42.879040 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:42.885434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:42.885886 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:42.886639 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:42.887073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:43.027152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:43.035733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c1e23367-144f-42f2-a6d4-0e6331fd97c4 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.161092 Jul 16 12:54:43.036303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 297/585] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:42 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:43.882796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:43.883448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:43.889904 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:43.890352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:43.891140 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:43.891570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:44.021951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:44.026588 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-130c8164-f0d4-41c7-bc5b-3cfb3ffff2c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.147700 Jul 16 12:54:44.027167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 289/586] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:43 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:44.052964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:44.053893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:44.060385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:44.060829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:44.062226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:44.062946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:44.210171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:44.218771 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d8a2bbe2-962c-4e65-ba75-eb845bf9ae30 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.169159 Jul 16 12:54:44.219270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 298/587] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:44 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:45.044232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:45.044828 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:45.052001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:45.052469 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:45.053497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:45.053936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:45.184841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:45.193362 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fe871958-484c-476e-bb51-8a118423b517 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.152966 Jul 16 12:54:45.193922 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 290/588] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:45 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:45.235570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:45.236182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:45.242784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:45.243228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:45.243985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:45.244415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:45.384159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:45.392083 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cb0f7c9a-b3bc-4889-b49a-aa25befb7e49 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.161045 Jul 16 12:54:45.392657 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 299/589] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:45 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:46.210502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:46.211131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:46.217563 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:46.218264 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:46.219148 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:46.219584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:46.222209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:46.351517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:46.358778 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4a51a2d2-3bb5-440d-b2e7-f80eb73d924f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.152118 Jul 16 12:54:46.359336 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 291/590] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:46 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:46.409800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:46.410400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:46.416747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:46.417230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:46.417984 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:46.418415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:46.565775 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:46.573782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4cd47068-12ca-459e-b22e-8227517dde99 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.167910 Jul 16 12:54:46.574342 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 300/591] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:46 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:47.375603 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:47.376218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:47.383403 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:47.383846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:47.384605 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:47.385062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:47.519368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:47.526878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4ff937e1-108f-4137-8810-be2ec87e4d32 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.155117 Jul 16 12:54:47.527440 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 292/592] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:47 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:47.591210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:47.591842 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:47.598524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:47.598964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:47.599715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:47.600141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:47.739895 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:47.747702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d5184aa7-2851-4aaa-b594-777632e52e2e tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.160477 Jul 16 12:54:47.748263 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 301/593] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:47 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:48.545159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:48.545736 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:48.552559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:48.553000 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:48.554037 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:48.554464 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:48.683757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:48.691617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-443cb535-9e9b-43a5-977e-d630653fb51a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.150352 Jul 16 12:54:48.692195 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 293/594] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:48 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:48.766379 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:48.766985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:48.773438 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:48.773881 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:48.774635 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:48.775058 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:48.916863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:48.924941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fd851187-849e-45f4-9064-0639a4c95d36 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.162929 Jul 16 12:54:48.925543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 302/595] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:48 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:49.708120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:49.708733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:49.715209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:49.715663 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:49.716429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:49.716867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:49.842287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:49.850203 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8fc7c6f3-968a-4660-9abd-578f1ad26e2f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.146002 Jul 16 12:54:49.850775 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 294/596] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:49 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:49.941512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:49.942125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:49.948391 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:49.948836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:49.949659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:49.950097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:49.968524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:54:50.095389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:50.103190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7517edbb-f697-48e3-a75c-a867fa02e363 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1754 microversion: 2.1 time: 0.165465 Jul 16 12:54:50.103757 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 303/597] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:49 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:50.867827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:50.868461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:50.875735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:50.876173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:50.876923 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:50.877380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:51.012050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:51.019718 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-210125aa-bf61-4082-bea6-7becb9ff5120 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.155745 Jul 16 12:54:51.020287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 295/598] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:50 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:51.121336 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:51.121936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:51.128931 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:51.129411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:51.130167 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:51.130603 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:51.270411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:51.278355 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6f7133c6-7d0c-4414-87cb-2cb7b08a5d62 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1757 microversion: 2.1 time: 0.160977 Jul 16 12:54:51.278921 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 304/599] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:51 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:52.036804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:52.037432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:52.043802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:52.044239 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:52.044985 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:52.045439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:52.173285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:52.181000 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d5c326ff-664b-482b-8ec0-4a4aa9589632 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.148041 Jul 16 12:54:52.181641 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 296/600] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:52 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:52.909555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:52.910152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:52.916237 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:52.916685 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:52.917466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:52.917900 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:52.941489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7a2c8df7-72f2-4f7d-bd4e-d83247ec8207 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/ips" status: 200 len: 149 microversion: 2.1 time: 0.087283 Jul 16 12:54:52.942032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 305/601] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:54:52 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/ips => generated 149 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:54:52.952534 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8185f808-94d2-4e43-8a8a-4d0a6ca96c6f"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:52.953706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:52.959625 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:52.960070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:52.960820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:52.961283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.039728 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Invalid volume: volume 8185f808-94d2-4e43-8a8a-4d0a6ca96c6f is already attached to instances: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: POST /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/os-volume_attachments HTTP/1.1 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 74 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:54:53.041498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {"volumeAttachment": {"volumeId": "8185f808-94d2-4e43-8a8a-4d0a6ca96c6f"}} Jul 16 12:54:53.043070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Invalid volume: volume 8185f808-94d2-4e43-8a8a-4d0a6ca96c6f is already attached to instances: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'server_id': 'cc230ed2-1599-4afc-91fb-7db62d977189', 'body': {'volumeAttachment': {'volumeId': '8185f808-94d2-4e43-8a8a-4d0a6ca96c6f'}}} Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8185f808-94d2-4e43-8a8a-4d0a6ca96c6f is already attached to instances: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:53.043932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8185f808-94d2-4e43-8a8a-4d0a6ca96c6f is already attached to instances: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:53.045328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8185f808-94d2-4e43-8a8a-4d0a6ca96c6f is already attached to instances: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 400 to user: Invalid volume: volume 8185f808-94d2-4e43-8a8a-4d0a6ca96c6f is already attached to instances: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-838d631b-61c5-483f-8513-c6f93986aef6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094533 Jul 16 12:54:53.047484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 297/602] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:54:52 2022] POST /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 16 12:54:53.052466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:53.052997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:53.059244 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:53.059689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.060440 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:53.060870 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.084610 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:54:53.198117 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:53.198872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:53.207301 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:53.207747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.208499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:53.208927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.322965 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-91d91518-cc38-4960-8eb6-8013a07caffa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 204 len: 0 microversion: 2.1 time: 0.273919 Jul 16 12:54:53.323599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 306/603] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:54:53 2022] DELETE /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:54:53.334226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:53.334933 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:53.341510 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:53.341954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.343327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:53.344496 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:53.491225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:53.498917 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-47693eb0-da81-461b-8f38-bc36bad1a8a7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1682 microversion: 2.1 time: 0.169506 Jul 16 12:54:53.499637 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 307/604] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:53 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:53.569679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:53.577837 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-05ce72ed-f5f8-4f94-b702-e1110a060e0a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.382899 Jul 16 12:54:53.578842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 298/605] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:53 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:54.516412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:54.516945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:54.523484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:54.523925 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:54.524668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:54.525122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:54.595208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:54.595830 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:54.602015 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:54.602462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:54.603218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:54.603650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:54.659241 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:54.667096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-60a790d2-7e61-4713-88b8-6ee7f705803e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1682 microversion: 2.1 time: 0.155217 Jul 16 12:54:54.667937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 308/606] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:54 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:54.738103 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:54.745506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b534d695-3197-4b9d-a5f1-fc142e0b5bbd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1676 microversion: 2.1 time: 0.154320 Jul 16 12:54:54.746061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 299/607] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:54 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:55.687019 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:55.687687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:55.694094 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:55.694545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:55.696128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:55.696128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:55.763536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:55.767287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:55.772581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:55.772889 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:55.773865 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:55.774499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:55.929508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:55.935595 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cf21d522-d2b8-478a-a402-74aa601e23a8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1682 microversion: 2.1 time: 0.253505 Jul 16 12:54:55.945578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 309/608] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:55 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:55.982842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:55.991685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c421524c-8985-4457-9b4c-843db506c9ba tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1653 microversion: 2.1 time: 0.232029 Jul 16 12:54:55.992567 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 300/609] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:55 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1653 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:54:56.008046 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7659c656-d15f-46ff-a561-f0fc81ac7758 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:56.014165 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7659c656-d15f-46ff-a561-f0fc81ac7758 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:56.014672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7659c656-d15f-46ff-a561-f0fc81ac7758 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:56.037307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7659c656-d15f-46ff-a561-f0fc81ac7758 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Going to try to start instance {{(pid=124651) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 16 12:54:56.269287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7659c656-d15f-46ff-a561-f0fc81ac7758 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action" status: 202 len: 0 microversion: 2.1 time: 0.265009 Jul 16 12:54:56.273860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 310/610] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:54:56 2022] POST /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:56.278421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:56.279104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:56.286158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:56.286717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:56.287684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:56.288177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:56.514523 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:56.531908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bced8c92-d962-4c92-9e09-053ba99dec09 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1662 microversion: 2.1 time: 0.256041 Jul 16 12:54:56.535235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-7ec0fdc8-71fc-4ab5-9369-07003e6460da req-0a1f9cbd-67c9-4786-8c76-e1712b27b553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc230ed2-1599-4afc-91fb-7db62d977189", "name": "network-vif-deleted", "tag": "91be992a-dc95-41be-9780-a802edcdba39"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:54:56.548862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-7ec0fdc8-71fc-4ab5-9369-07003e6460da req-0a1f9cbd-67c9-4786-8c76-e1712b27b553 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:56.549687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 301/611] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:56 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1662 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:56.554473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-7ec0fdc8-71fc-4ab5-9369-07003e6460da req-0a1f9cbd-67c9-4786-8c76-e1712b27b553 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:56.574700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-7ec0fdc8-71fc-4ab5-9369-07003e6460da req-0a1f9cbd-67c9-4786-8c76-e1712b27b553 service nova] Creating event network-vif-deleted:91be992a-dc95-41be-9780-a802edcdba39 for instance cc230ed2-1599-4afc-91fb-7db62d977189 on hv-cinder-83697 Jul 16 12:54:56.580687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-7ec0fdc8-71fc-4ab5-9369-07003e6460da req-0a1f9cbd-67c9-4786-8c76-e1712b27b553 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119945 Jul 16 12:54:56.581862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 311/612] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:54:56.954379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:56.956245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:56.965785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:56.966535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:56.967321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:56.967931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:57.012450 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:57.013232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:57.013642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lazy-loading 'fault' on Instance uuid cc230ed2-1599-4afc-91fb-7db62d977189 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:54:57.064567 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:57.072919 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2f509ceb-8c2e-4a91-961b-ff4607c65174 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 200 len: 1332 microversion: 2.1 time: 0.123246 Jul 16 12:54:57.073912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 302/613] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:56 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:57.568441 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:57.569451 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:57.577080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:57.577531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:57.579005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:57.579449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:57.737563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:57.745241 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a8ce71cc-0c76-4a38-9df6-315d965ab362 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1662 microversion: 2.1 time: 0.181926 Jul 16 12:54:57.745811 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 312/614] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:57 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:58.090823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:58.091832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:58.099354 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:58.099794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:58.100553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:58.100981 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:58.114570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 HTTP/1.1 Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:54:58.118770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:54:58.120319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'cc230ed2-1599-4afc-91fb-7db62d977189'} Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:54:58.121212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:54:58.122658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:54:58.123914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:54:58.123914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dac4b919-c6e3-48e7-b264-72c1e72aa1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 404 len: 111 microversion: 2.1 time: 0.030548 Jul 16 12:54:58.123914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 303/615] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:58 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:54:58.127395 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ba3b710a-4962-4cc7-98dd-240622347fce tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '.version_select at 0x7f6cf8dd4670>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:58.236702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ba3b710a-4962-4cc7-98dd-240622347fce tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023673006" status: 202 len: 0 microversion: 2.1 time: 0.113739 Jul 16 12:54:58.237376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 313/616] 10.222.0.47 () {58 vars in 1220 bytes} [Sat Jul 16 12:54:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023673006 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:58.762974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:58.763743 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:58.770021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:58.770476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:58.771241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:58.771713 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:58.901857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:54:58.910410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6d3527e2-59aa-4be5-a319-a0d91dace29f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1666 microversion: 2.1 time: 0.151316 Jul 16 12:54:58.910961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 304/617] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:54:58 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:54:59.084480 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:59.084999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:59.090872 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:59.091312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:59.092060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:59.092490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:59.174530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lazy-loading 'services' on Instance uuid 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:54:59.416239 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-275e036e-2890-47a2-bf9c-f778938fc828 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments/8185f808-94d2-4e43-8a8a-4d0a6ca96c6f" status: 202 len: 0 microversion: 2.1 time: 0.335968 Jul 16 12:54:59.416860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 314/618] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:54:59 2022] DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments/8185f808-94d2-4e43-8a8a-4d0a6ca96c6f => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:54:59.425642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:54:59.426568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:54:59.433198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:59.437064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:59.437064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:54:59.437064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:54:59.463569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7c180fb1-7e09-416c-8491-a27054aae939 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042390 Jul 16 12:54:59.464119 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 305/619] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:54:59 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:00.476671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:00.477704 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:00.483879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:00.484973 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:00.485825 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:00.486220 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:00.517982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2a4313a0-8615-4895-a99d-694e64809862 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Jul 16 12:55:00.518473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 315/620] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:55:00 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:01.529610 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:01.530423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:01.536995 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:01.537472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:01.538225 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:01.538658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:01.568157 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-556ff712-f776-4d37-8277-2140ca3dd75b tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042578 Jul 16 12:55:01.568707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 306/621] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:55:01 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 16 12:55:01.625716 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:01.626209 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:01.632556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:01.633006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:01.633797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:01.634231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:01.658301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:55:01.951409 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-eb8e7e6f-5e32-4c1a-8059-532960c83345 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 204 len: 0 microversion: 2.1 time: 0.329944 Jul 16 12:55:01.952016 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 316/622] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:55:01 2022] DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:55:01.960433 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:01.961060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:01.967026 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:01.967544 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:01.968298 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:01.969273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:02.097398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:02.104933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b345bd82-e9f7-4f20-9e7b-ca53ea9fcfe7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1679 microversion: 2.1 time: 0.148328 Jul 16 12:55:02.105465 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 307/623] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:01 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:03.123181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:03.123882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:03.131556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:03.132002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:03.132789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:03.133251 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:03.137518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:03.351386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:03.358887 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e6ac98de-19a8-4062-9a62-2a603dcca985 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1679 microversion: 2.1 time: 0.240051 Jul 16 12:55:03.360142 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 317/624] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:03 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:04.251948 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-a3fad937-fc55-4fa3-b7dc-30c50d0ea7d2 req-fab81bbe-9468-47f9-932a-d75173e25325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f070ffc-5fc4-42f9-b2e5-d8420a80af13", "name": "network-vif-deleted", "tag": "3c569d6d-b7a5-4017-b67f-7d71f2b5081a"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:04.256512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=56 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:04.261971 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-a3fad937-fc55-4fa3-b7dc-30c50d0ea7d2 req-fab81bbe-9468-47f9-932a-d75173e25325 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:04.264602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-a3fad937-fc55-4fa3-b7dc-30c50d0ea7d2 req-fab81bbe-9468-47f9-932a-d75173e25325 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:04.268094 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=100 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:04.277544 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-a3fad937-fc55-4fa3-b7dc-30c50d0ea7d2 req-fab81bbe-9468-47f9-932a-d75173e25325 service nova] Creating event network-vif-deleted:3c569d6d-b7a5-4017-b67f-7d71f2b5081a for instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 on hv-cinder-83697 Jul 16 12:55:04.283038 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-a3fad937-fc55-4fa3-b7dc-30c50d0ea7d2 req-fab81bbe-9468-47f9-932a-d75173e25325 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158910 Jul 16 12:55:04.283650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 308/625] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:04.382193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:04.382193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:04.382193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:04.384460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:04.384916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:04.385711 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:04.386145 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:04.455377 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:04.463177 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ce211885-4972-40f6-b5e1-c760e9211a32 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 200 len: 1325 microversion: 2.1 time: 0.091082 Jul 16 12:55:04.470737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 318/626] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:04 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:05.486126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:05.486821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:05.493861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:05.494305 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:05.495059 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:05.495498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:05.509329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 HTTP/1.1 Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:55:05.510949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:55:05.512521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '0f070ffc-5fc4-42f9-b2e5-d8420a80af13'} Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:55:05.513432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:55:05.514925 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:05.517398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:55:05.517398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2af9552e-6686-4022-9882-181bd3d7c9a2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 404 len: 111 microversion: 2.1 time: 0.030977 Jul 16 12:55:05.517398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 309/627] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:05 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:55:05.522187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-064dc820-d3e3-4d1a-9067-4f1464eea0d3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '.version_select at 0x7f6cf8e27670>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:05.603561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-064dc820-d3e3-4d1a-9067-4f1464eea0d3 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579021624" status: 202 len: 0 microversion: 2.1 time: 0.085413 Jul 16 12:55:05.604139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 319/628] 10.222.0.47 () {58 vars in 1217 bytes} [Sat Jul 16 12:55:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579021624 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:55:06.562930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fcec7150-1953-466a-8103-64955850d07e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: .version_select at 0x7f6cf8b93040>, body: {"keypair": {"name": "tempest-keypair-1514140658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP/wTu756Nw03Nt8aps0PXcyAwei6J414U4VzbTVslADDbqN1YJO6DLfVEFTR6MB7UbWObxhiVTOyjutdFAHR/xWm784KDm1yALAoHZBMAEQeQ+hf6WpW/tsIlDDnZ+nA=="}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:06.577186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-fcec7150-1953-466a-8103-64955850d07e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:55:06.580922 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-fcec7150-1953-466a-8103-64955850d07e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:55:06.638079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fcec7150-1953-466a-8103-64955850d07e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079040 Jul 16 12:55:06.638673 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 310/629] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:55:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:08.669138 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1327629280", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a354d703-6ba1-41fe-886d-bd8338eb5858"}], "security_groups": [{"name": "tempest-securitygroup--1999098330"}], "key_name": "tempest-keypair-1514140658", "user_data": "}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:08.770387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] validate_networks() for [('a354d703-6ba1-41fe-886d-bd8338eb5858', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:55:09.204660 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:55:09.205122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:55:09.205597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:55:09.206006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:55:09.206439 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:55:09.215285 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:09.215725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:09.216515 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:09.216948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:09.234069 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:55:09.237975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:55:09.248712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:55:09.251088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:55:09.376633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1be91feb-672e-41fc-a051-028de9fee1a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712448 Jul 16 12:55:09.377678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 320/630] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:55:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:55:09.388100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e6bd9d71-a4a5-4d7f-9ef4-af435fea1450 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:09.388829 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e6bd9d71-a4a5-4d7f-9ef4-af435fea1450 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:09.457439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e6bd9d71-a4a5-4d7f-9ef4-af435fea1450 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:09.465170 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e6bd9d71-a4a5-4d7f-9ef4-af435fea1450 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1242 microversion: 2.1 time: 0.081465 Jul 16 12:55:09.465989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 311/631] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:09 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:10.482658 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:10.483277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:10.490448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:10.490878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:10.491649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:10.492080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:10.558786 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:10.567487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6781a513-60f4-4dc1-b0c0-299e563dd57a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1246 microversion: 2.1 time: 0.089177 Jul 16 12:55:10.570648 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 321/632] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:10 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:11.588079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:11.589798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:11.597930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:11.598380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:11.599157 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:11.599594 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:11.663277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:11.671275 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3afdedc8-7eae-4c00-b5d1-b3212764cb82 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1302 microversion: 2.1 time: 0.087244 Jul 16 12:55:11.671854 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 312/633] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:11 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:55:12.689300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:12.690068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:12.696701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:12.697196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:12.697950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:12.698378 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:12.920649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:12.928493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-157f2972-d8c2-4978-aca5-a017adf0c42c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.243184 Jul 16 12:55:12.929415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 322/634] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:12 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:13.154587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-c59dac85-432d-4967-8bfa-fcd568ca8212 req-d00f5a78-8e30-433d-b001-0ff7a150c1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b69d9d-a0a8-472f-86da-9608601291a3", "tag": "47f7f08d-df06-425a-b07d-43b67a538d9c"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:13.164436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-c59dac85-432d-4967-8bfa-fcd568ca8212 req-d00f5a78-8e30-433d-b001-0ff7a150c1a2 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:13.165175 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-c59dac85-432d-4967-8bfa-fcd568ca8212 req-d00f5a78-8e30-433d-b001-0ff7a150c1a2 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:13.178122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-c59dac85-432d-4967-8bfa-fcd568ca8212 req-d00f5a78-8e30-433d-b001-0ff7a150c1a2 service nova] Creating event network-changed:47f7f08d-df06-425a-b07d-43b67a538d9c for instance 87b69d9d-a0a8-472f-86da-9608601291a3 on hv-cinder-83697 Jul 16 12:55:13.184348 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-c59dac85-432d-4967-8bfa-fcd568ca8212 req-d00f5a78-8e30-433d-b001-0ff7a150c1a2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033629 Jul 16 12:55:13.185201 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 313/635] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:13.946020 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:13.946629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:13.953227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:13.953680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:13.955212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:13.955652 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:14.087270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:14.094595 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-af97623c-42cd-400b-bfc0-5944b0983d6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.152442 Jul 16 12:55:14.095482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 323/636] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:13 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:15.113583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:15.114282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:15.120400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.120849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.121709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.122145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.249791 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:15.258907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cc7199e0-7b73-481e-8a0e-f8d6554dad97 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.150679 Jul 16 12:55:15.259484 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 314/637] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:15 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:15.357492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:15.358053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:15.364868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.365297 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.366059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.366494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.395017 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-48ec5b5b-899d-46dd-a090-2ef94c25793d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments/d0e12340-66b3-4d5a-936f-f0635e87e65d" status: 200 len: 194 microversion: 2.20 time: 0.146306 Jul 16 12:55:15.395576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 324/638] 10.222.0.47 () {60 vars in 1453 bytes} [Sat Jul 16 12:55:15 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments/d0e12340-66b3-4d5a-936f-f0635e87e65d => generated 194 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 16 12:55:15.459468 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:15.460140 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:15.466517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.466958 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.467706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.468137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.547085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lazy-loading 'services' on Instance uuid 80af442b-e294-4d43-9279-a6ee29d6325d {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:55:15.744630 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-09bc92a5-2317-4c19-9c28-06a47fc30621 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments/d0e12340-66b3-4d5a-936f-f0635e87e65d" status: 202 len: 0 microversion: 2.20 time: 0.288959 Jul 16 12:55:15.745270 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 315/639] 10.222.0.47 () {60 vars in 1456 bytes} [Sat Jul 16 12:55:15 2022] DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments/d0e12340-66b3-4d5a-936f-f0635e87e65d => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:55:15.754650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:15.755657 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:15.761681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.762127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.762880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:15.763315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:15.791454 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-516bbe69-105b-48ac-b99c-35e5d8656aa3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041707 Jul 16 12:55:15.792005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 325/640] 10.222.0.47 () {60 vars in 1342 bytes} [Sat Jul 16 12:55:15 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:55:16.276954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:16.277710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:16.284663 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:16.285141 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:16.285910 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:16.286342 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:16.422749 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:16.430720 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2d421b44-1321-43ae-bd8f-6906173e8223 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.158680 Jul 16 12:55:16.431288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 316/641] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:16 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:16.804452 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:16.805429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:16.811830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:16.812284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:16.813067 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:16.813514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:16.844044 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-47a573a4-8744-4879-95ec-b77296bf4e70 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044802 Jul 16 12:55:16.844611 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 326/642] 10.222.0.47 () {60 vars in 1342 bytes} [Sat Jul 16 12:55:16 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:55:17.447562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:17.448088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:17.454644 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:17.456700 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:17.456700 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:17.456700 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:17.589222 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:17.599722 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-eca541ab-4314-472d-8202-fa27d18dcb2a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.155699 Jul 16 12:55:17.600349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 317/643] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:17 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:17.855841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:17.856683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:17.863779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:17.864219 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:17.864976 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:17.865436 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:17.894215 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-588f785c-22ea-42ab-acde-bf58e7f4eda9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042477 Jul 16 12:55:17.894776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 327/644] 10.222.0.47 () {60 vars in 1342 bytes} [Sat Jul 16 12:55:17 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:17.952832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:17.953617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:17.960389 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:17.960841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:17.961645 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:17.962083 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:17.986655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:55:18.294567 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-728b4997-bf34-4e5a-97da-1c82decf26c6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 204 len: 0 microversion: 2.20 time: 0.345683 Jul 16 12:55:18.295190 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 318/645] 10.222.0.47 () {60 vars in 1279 bytes} [Sat Jul 16 12:55:17 2022] DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 16 12:55:18.305003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:18.305725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:18.311937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:18.312387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:18.313490 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:18.313929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:18.317373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-3d5049e0-4f6f-47e5-80d1-84fcfb7f766c req-84ccd9c6-9bf8-47ad-a9bb-0841c5d190b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b69d9d-a0a8-472f-86da-9608601291a3", "name": "network-vif-plugged", "status": "completed", "tag": "47f7f08d-df06-425a-b07d-43b67a538d9c"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:18.326405 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3d5049e0-4f6f-47e5-80d1-84fcfb7f766c req-84ccd9c6-9bf8-47ad-a9bb-0841c5d190b1 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:18.326869 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3d5049e0-4f6f-47e5-80d1-84fcfb7f766c req-84ccd9c6-9bf8-47ad-a9bb-0841c5d190b1 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:18.338545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-3d5049e0-4f6f-47e5-80d1-84fcfb7f766c req-84ccd9c6-9bf8-47ad-a9bb-0841c5d190b1 service nova] Creating event network-vif-plugged:47f7f08d-df06-425a-b07d-43b67a538d9c for instance 87b69d9d-a0a8-472f-86da-9608601291a3 on hv-cinder-83697 Jul 16 12:55:18.343855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-3d5049e0-4f6f-47e5-80d1-84fcfb7f766c req-84ccd9c6-9bf8-47ad-a9bb-0841c5d190b1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089278 Jul 16 12:55:18.345167 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 328/646] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:18.459903 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:18.467701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:18.469221 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:18.470371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cdaa4bb0-045e-4e13-9118-4134240c983e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.170762 Jul 16 12:55:18.470949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 319/647] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:18 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:18.618149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:18.618846 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:18.625063 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:18.625517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:18.626266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:18.626700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:18.756552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:18.763900 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2f585ea6-7877-48ef-b9b7-8210bf7d446e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.149970 Jul 16 12:55:18.764461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 329/648] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:18 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:55:19.493294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:19.493294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:19.493294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:19.497508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:19.497952 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:19.498702 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:19.499133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:19.629376 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:19.637227 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:19.638727 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:19.639882 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4708ff4a-724c-46df-82db-c8ec43666fdb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.155040 Jul 16 12:55:19.640442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 320/649] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:19 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:19.780869 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:19.781514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:19.784977 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:19.785697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:19.791577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:19.791989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:19.796959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:19.796959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:19.926789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:19.934824 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fc34d2ea-7204-4ec9-9aad-79d9a1544eab tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.157977 Jul 16 12:55:19.935385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 330/650] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:19 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:20.658675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:20.659308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:20.665781 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:20.666239 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:20.666986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:20.667434 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:20.901693 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:20.909735 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:20.911258 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:20.912445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e3b6646d-65fb-4065-8f7c-0afc6d26a4b3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1724 microversion: 2.20 time: 0.257833 Jul 16 12:55:20.913001 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 321/651] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:20 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:20.951735 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:20.952344 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:20.958798 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:20.959244 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:20.959999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:20.960433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:21.091613 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-23b3443b-d9d8-43fc-b922-a27f424e1d7d req-74aed549-0091-4691-a682-e1066a0f4fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80af442b-e294-4d43-9279-a6ee29d6325d", "name": "network-vif-deleted", "tag": "421a085a-7a63-4cbe-aad0-cff6ba09a318"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:21.098652 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:21.101827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-23b3443b-d9d8-43fc-b922-a27f424e1d7d req-74aed549-0091-4691-a682-e1066a0f4fbf service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:21.102430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-23b3443b-d9d8-43fc-b922-a27f424e1d7d req-74aed549-0091-4691-a682-e1066a0f4fbf service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:21.106437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-84785751-5348-4a1a-a5f5-adac6ce73b46 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.158506 Jul 16 12:55:21.111207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 331/652] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:20 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:21.121246 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-23b3443b-d9d8-43fc-b922-a27f424e1d7d req-74aed549-0091-4691-a682-e1066a0f4fbf service nova] Creating event network-vif-deleted:421a085a-7a63-4cbe-aad0-cff6ba09a318 for instance 80af442b-e294-4d43-9279-a6ee29d6325d on hv-cinder-83697 Jul 16 12:55:21.126266 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-23b3443b-d9d8-43fc-b922-a27f424e1d7d req-74aed549-0091-4691-a682-e1066a0f4fbf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038305 Jul 16 12:55:21.127100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 322/653] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:21.932011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:21.932821 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:21.939260 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:21.940688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:21.941553 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:21.941996 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:21.974353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:21.974983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:21.975247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lazy-loading 'fault' on Instance uuid 80af442b-e294-4d43-9279-a6ee29d6325d {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:55:22.020248 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:22.028152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:22.029703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:22.030863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-79d143ec-bd0b-49da-9a48-fbba370967b2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 200 len: 1372 microversion: 2.20 time: 0.103319 Jul 16 12:55:22.031407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 332/654] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:21 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:22.124596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:22.125311 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:22.131648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:22.132085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:22.132835 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:22.133290 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:22.272514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:22.279717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9971c97f-9f2a-4f40-9618-5ec2828551b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1368 microversion: 2.1 time: 0.159749 Jul 16 12:55:22.281254 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 323/655] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:22 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:23.049313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:23.049911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:23.056634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:23.057111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:23.057866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:23.058322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:23.071965 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] HTTP exception thrown: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Request method failure captured: Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d HTTP/1.1 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO7JGIK9L37zHSxJYihPAkwixb6DhgGcdj_Ar1nRHORx7uPBDEBk7TMAnfDj_NLvaoqqFUe5XYi7QtUrwKmqG4_YnVzZdiEwH8l-uFyEshydc4UltVjJ8UzerSSkCwiWEK-0Fp6maWlZ28I7EitKBV4ah_GsQWhYVICE4m6Fn1qpU8 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Openstack-Nova-Api-Version: 2.20 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:55:23.073623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f762c3c164904a3bb6e64985744c1765", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 3e12d902f94b40cea088dc6f24dcb444 Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:55:23.075264 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '80af442b-e294-4d43-9279-a6ee29d6325d'} Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:55:23.076461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:55:23.078008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:23.079494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Returning 404 to user: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:55:23.079494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2b1021e9-7755-448f-9365-e582384754c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 404 len: 111 microversion: 2.20 time: 0.029665 Jul 16 12:55:23.079494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 333/656] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:23 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:55:23.084767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ce906b55-058d-4aa8-bee0-26a8e1932cdd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '.version_select at 0x7f6cf8b93b80>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:23.161927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ce906b55-058d-4aa8-bee0-26a8e1932cdd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704046158" status: 204 len: 0 microversion: 2.20 time: 0.081803 Jul 16 12:55:23.162600 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 324/657] 10.222.0.47 () {60 vars in 1261 bytes} [Sat Jul 16 12:55:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704046158 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 16 12:55:23.296959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:23.297622 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:23.304413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:23.304805 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:23.305617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:23.306035 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:23.454587 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:23.462551 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cb42499d-bb02-4231-ab22-fa866f4efe3c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1558 microversion: 2.1 time: 0.169374 Jul 16 12:55:23.463123 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 334/658] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:23 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:23.479216 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:23.479986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:23.489644 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:23.490096 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:23.490878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:23.491321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:23.615042 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a2cbd622-b19e-4b36-b5ed-2be0bf4b2b4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139913 Jul 16 12:55:23.615648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 325/659] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:55:23 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:23.990658 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fbfb8679-878f-4164-8896-f85f84da561c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'create', calling method: .version_select at 0x7f6cf8dea820>, body: {"keypair": {"name": "tempest-keypair-670959870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqj8z9dHusWsTBGMVm6pUOMPThaF9KvxsI9jj5kyNCQfjFNi21YahkhKB8/4yDrVxsksLuHG/GpVh2QuSJDvlInxyIUYLMTXAN9kRccIi7RiuR1dvE+P0JUWsy/3C9Dtg=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:24.005383 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-fbfb8679-878f-4164-8896-f85f84da561c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for project f762c3c164904a3bb6e64985744c1765. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:55:24.009717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-fbfb8679-878f-4164-8896-f85f84da561c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for user 3e12d902f94b40cea088dc6f24dcb444 and project f762c3c164904a3bb6e64985744c1765. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:55:24.119226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fbfb8679-878f-4164-8896-f85f84da561c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.132629 Jul 16 12:55:24.120765 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 335/660] 10.222.0.47 () {62 vars in 1199 bytes} [Sat Jul 16 12:55:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 16 12:55:24.915589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-dfb13886-898a-4e05-b0e9-2a0b8fba0a04 req-bda29fe7-b19e-4156-a063-8e0a18702a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b69d9d-a0a8-472f-86da-9608601291a3", "tag": "47f7f08d-df06-425a-b07d-43b67a538d9c"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:24.923604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-dfb13886-898a-4e05-b0e9-2a0b8fba0a04 req-bda29fe7-b19e-4156-a063-8e0a18702a61 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:24.924622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-dfb13886-898a-4e05-b0e9-2a0b8fba0a04 req-bda29fe7-b19e-4156-a063-8e0a18702a61 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:24.936110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-dfb13886-898a-4e05-b0e9-2a0b8fba0a04 req-bda29fe7-b19e-4156-a063-8e0a18702a61 service nova] Creating event network-changed:47f7f08d-df06-425a-b07d-43b67a538d9c for instance 87b69d9d-a0a8-472f-86da-9608601291a3 on hv-cinder-83697 Jul 16 12:55:24.945878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-dfb13886-898a-4e05-b0e9-2a0b8fba0a04 req-bda29fe7-b19e-4156-a063-8e0a18702a61 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030503 Jul 16 12:55:24.945878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 326/661] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:55:26.679659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1701434285", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7dd031c-453e-4167-9cf1-2231fb050c9c"}], "security_groups": [{"name": "tempest-securitygroup--737939131"}], "key_name": "tempest-keypair-670959870", "user_data": "}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:26.783196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] validate_networks() for [('c7dd031c-453e-4167-9cf1-2231fb050c9c', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:55:27.149549 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:55:27.149974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:55:27.150444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:55:27.150852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:55:27.151291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:55:27.160071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:27.160512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:27.161334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:27.161768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:27.178653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for project f762c3c164904a3bb6e64985744c1765. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:55:27.182882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Getting quotas for user 3e12d902f94b40cea088dc6f24dcb444 and project f762c3c164904a3bb6e64985744c1765. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:55:27.194461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:55:27.196701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:55:27.319296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-db60344f-c7c4-4599-a28b-e6c3e0173e54 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.644892 Jul 16 12:55:27.319930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 336/662] 10.222.0.47 () {62 vars in 1187 bytes} [Sat Jul 16 12:55:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 16 12:55:27.331835 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-92d7e45a-69cf-4632-a513-e3bec89a5b1f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:27.332559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-92d7e45a-69cf-4632-a513-e3bec89a5b1f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:27.391898 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-92d7e45a-69cf-4632-a513-e3bec89a5b1f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:27.397452 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-92d7e45a-69cf-4632-a513-e3bec89a5b1f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:27.399383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-92d7e45a-69cf-4632-a513-e3bec89a5b1f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:27.400505 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-92d7e45a-69cf-4632-a513-e3bec89a5b1f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1281 microversion: 2.20 time: 0.074307 Jul 16 12:55:27.401086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 327/663] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:27 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:28.418952 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:28.419557 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:28.426699 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:28.427154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:28.427891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:28.428321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:28.494942 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:28.501760 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:28.503330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:28.504937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4da30989-4364-4353-96dc-5854837b5394 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1285 microversion: 2.20 time: 0.090417 Jul 16 12:55:28.505517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 337/664] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:28 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:28.717661 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:28.718215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:28.725978 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:28.726425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:28.727182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:28.727617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:28.807997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lazy-loading 'services' on Instance uuid d02979a6-4ccd-43dc-8b42-b36688cc13e1 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:55:29.028122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-624f12a9-2281-4d5a-ae02-9e56b95d4b56 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments/40df6a27-c622-4452-97eb-b7bc5d78b8d4" status: 202 len: 0 microversion: 2.1 time: 0.314274 Jul 16 12:55:29.028738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 328/665] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:55:28 2022] DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments/40df6a27-c622-4452-97eb-b7bc5d78b8d4 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:55:29.037302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:29.038298 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:29.044462 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:29.044905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:29.045692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:29.046121 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:29.049720 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=100 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:29.075429 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d9750eb6-9c3d-4088-8526-f5f93c8a74ba tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042308 Jul 16 12:55:29.075988 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 338/666] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:55:29 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:29.523950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:29.524566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:29.530930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:29.531375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:29.532129 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:29.532560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:29.546861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:29.658576 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:29.666369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:29.667865 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:29.671331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-35391279-7249-4e62-9960-966759b89be1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1341 microversion: 2.20 time: 0.150006 Jul 16 12:55:29.671331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 329/667] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:29 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1341 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:30.088272 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:30.089220 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:30.095761 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:30.096212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:30.096978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:30.097435 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:30.126600 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ff90b5fc-dc39-4c1b-bf57-f327b7ab9ecb tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Jul 16 12:55:30.127372 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 339/668] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:55:30 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:30.687818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:30.688421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:30.696751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:30.697247 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:30.698016 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:30.698450 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:30.896749 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:30.904110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:30.905660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:30.906770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a9d2f117-6095-4417-b971-a779fa44b8ee tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.222979 Jul 16 12:55:30.907329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 330/669] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:30 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:31.138898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:31.139810 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:31.146627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.147013 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.147763 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.148195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.179750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6ab64f30-ad12-4003-b883-0ef063ac4a99 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044821 Jul 16 12:55:31.180313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 340/670] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:55:31 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:55:31.250262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:31.250786 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:31.258024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.258507 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.259470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.260121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.287871 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:55:31.547245 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-92eb6ab7-37e6-4f02-8026-ac9febe9b06a req-d2a9a00e-8c0b-48c0-8105-e06f565ccd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:31.562243 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-92eb6ab7-37e6-4f02-8026-ac9febe9b06a req-d2a9a00e-8c0b-48c0-8105-e06f565ccd84 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.562683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-92eb6ab7-37e6-4f02-8026-ac9febe9b06a req-d2a9a00e-8c0b-48c0-8105-e06f565ccd84 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.570149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d4c00f0d-1243-4706-9d06-7d416523b10a tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 204 len: 0 microversion: 2.1 time: 0.323730 Jul 16 12:55:31.570738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 331/671] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:55:31 2022] DELETE /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:55:31.579375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:31.580400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:31.580882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-92eb6ab7-37e6-4f02-8026-ac9febe9b06a req-d2a9a00e-8c0b-48c0-8105-e06f565ccd84 service nova] Creating event network-changed:8a390625-6257-4d3b-a1a4-2f8ae239dbf9 for instance 5b82d74b-e87f-404e-b369-5bd7955f6318 on hv-cinder-83697 Jul 16 12:55:31.586363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-92eb6ab7-37e6-4f02-8026-ac9febe9b06a req-d2a9a00e-8c0b-48c0-8105-e06f565ccd84 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044216 Jul 16 12:55:31.588022 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.588545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.595577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 341/672] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:55:31.595694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.595694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.739072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:31.746765 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8a0de8b3-d4e6-4afd-adad-8849837f7399 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1689 microversion: 2.1 time: 0.171572 Jul 16 12:55:31.747340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 332/673] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:31 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:55:31.926372 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:31.927027 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:31.933492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.933948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:31.934714 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:31.935155 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:32.061730 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:32.069694 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:32.071184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:32.072282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-53b5c11d-67fc-49fc-8194-88fb7c5dcbfb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.150977 Jul 16 12:55:32.072857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 342/674] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:31 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:32.764365 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:32.764967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:32.771540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:32.772010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:32.772738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:32.773202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:32.900654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:32.908164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c1aabed4-e1b7-45f6-8a58-7cbc7101b6a6 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1689 microversion: 2.1 time: 0.147716 Jul 16 12:55:32.908722 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 333/675] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:32 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:33.090824 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:33.091452 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:33.098147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:33.098599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:33.099362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:33.099801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:33.232858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:33.241424 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:33.242972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:33.244076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-825aa941-7279-4f2a-ad6c-1e69e82fa3c9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.157200 Jul 16 12:55:33.244628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 343/676] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:33 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:33.925877 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:33.926499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:33.933207 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:33.933651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:33.934408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:33.934838 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:34.067560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:34.074987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bdfbdb95-8051-4bc6-a3f7-355be0213d3f tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1689 microversion: 2.1 time: 0.153239 Jul 16 12:55:34.075589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 334/677] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:33 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:34.260987 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:34.261628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:34.268045 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:34.268494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:34.269865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:34.270306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:34.398064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:34.405998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:34.407506 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:34.408612 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2358310e-f634-4ce0-b033-a5bfd92097fa tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.151485 Jul 16 12:55:34.409197 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 344/678] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:34 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:35.092024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:35.092692 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:35.099375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:35.099825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:35.100597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:35.101031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:35.263482 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:35.271408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a32eb335-fc66-4bc6-a90d-8a76f8808771 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1689 microversion: 2.1 time: 0.183615 Jul 16 12:55:35.271962 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 335/679] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:35 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:35.427353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:35.427941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:35.430819 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:35.435427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:35.435877 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:35.436773 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:35.437243 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:35.641073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:35.649741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:35.651314 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:35.652613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7ef8fb9c-99b2-42c8-9c2a-1487613ad2d3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.229803 Jul 16 12:55:35.653269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 345/680] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:35 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:36.287944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:36.288550 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:36.291066 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:36.295725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:36.296192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:36.298526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:36.298526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:36.361140 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:36.369315 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a56c9137-fa4f-4de3-a80d-a2642c61d37c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1622 microversion: 2.1 time: 0.085165 Jul 16 12:55:36.373181 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 336/681] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:36 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:36.449727 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-6db8a011-a815-439b-8e37-633b325f2d61 req-ffde967b-f0db-4029-8d15-4db28785b258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02979a6-4ccd-43dc-8b42-b36688cc13e1", "name": "network-vif-deleted", "tag": "13daf266-af42-46b2-bd78-b769f2736bda"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:36.458389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-6db8a011-a815-439b-8e37-633b325f2d61 req-ffde967b-f0db-4029-8d15-4db28785b258 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:36.458832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-6db8a011-a815-439b-8e37-633b325f2d61 req-ffde967b-f0db-4029-8d15-4db28785b258 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:36.469578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-6db8a011-a815-439b-8e37-633b325f2d61 req-ffde967b-f0db-4029-8d15-4db28785b258 service nova] Creating event network-vif-deleted:13daf266-af42-46b2-bd78-b769f2736bda for instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 on hv-cinder-83697 Jul 16 12:55:36.475591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-6db8a011-a815-439b-8e37-633b325f2d61 req-ffde967b-f0db-4029-8d15-4db28785b258 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029629 Jul 16 12:55:36.476273 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 346/682] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:36.670018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:36.670637 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:36.677183 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:36.677631 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:36.678399 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:36.678840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:36.809364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:36.817524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:36.819039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:36.820152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b41f7c28-6a1a-4cf2-9d6b-c0acf1927e2a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.154072 Jul 16 12:55:36.820921 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 337/683] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:36 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:37.384125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:37.385014 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=10 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:37.389431 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:37.391915 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:37.397644 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:37.398125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:37.398897 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:37.399326 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:37.468366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:37.476976 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c3fc07e6-dc81-49eb-820f-96d4feb4324b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1622 microversion: 2.1 time: 0.093743 Jul 16 12:55:37.477769 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 347/684] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:37 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:37.838445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:37.839054 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:37.841354 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:37.846159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:37.846608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:37.848067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:37.848508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:37.982660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:37.991044 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:37.992539 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:37.993779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8d75791c-888f-403b-a760-f46f18305ea0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.159198 Jul 16 12:55:37.994339 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 338/685] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:37 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:38.494577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:38.495186 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:38.502260 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:38.502703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:38.503603 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:38.504043 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:38.533619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:38.534059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:38.535192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lazy-loading 'fault' on Instance uuid d02979a6-4ccd-43dc-8b42-b36688cc13e1 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:55:38.576064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:38.585067 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fdd96f58-2a1b-4877-bd65-7f1548b94ec9 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 200 len: 1336 microversion: 2.1 time: 0.093778 Jul 16 12:55:38.585806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 348/686] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:38 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:39.011626 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:39.012271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:39.019395 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:39.019797 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:39.020549 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:39.020978 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:39.150584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:39.158449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:39.159953 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:39.161182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8fadf64f-b7f7-4c4a-ac67-993ff28a9eb6 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.153479 Jul 16 12:55:39.161739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 339/687] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:39 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:39.602115 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:39.602718 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d02979a6-4ccd-43dc-8b42-b36688cc13e1] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:39.609434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:39.609916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:39.610670 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:39.611097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:39.624922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] HTTP exception thrown: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 could not be found. Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Request method failure captured: Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 HTTP/1.1 Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAgQ6BYa-iX_hNve8Uc-CRe2aYeOgmDm9JDPJTlq7hkROymxYhIgaGSFyhCoU6Mpn7e_x5tR8kbL6pj7P6_jm7hOCGVtuxQO52nLx9tQJ5CbQOtkIqzWVarD-VaE0opcGZG6M-p6xJipLr3uOCY0BbVVxmpXWi37xxME__L6ta2VE Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:55:39.626552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6e8a673b65b64fbc916da4ce4cdc9f81", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f1c9a7f942c541a287da38a894f1d1f9 Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 could not be found. Jul 16 12:55:39.628077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'd02979a6-4ccd-43dc-8b42-b36688cc13e1'} Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 could not be found. Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:55:39.629563 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 could not be found. Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 could not be found. Jul 16 12:55:39.630989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:39.632287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Returning 404 to user: Instance d02979a6-4ccd-43dc-8b42-b36688cc13e1 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:55:39.632287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f4b3a62e-c4de-408d-bd71-86d79fb12c22 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1" status: 404 len: 111 microversion: 2.1 time: 0.029904 Jul 16 12:55:39.632287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 349/688] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:39 2022] GET /compute/v2.1/servers/d02979a6-4ccd-43dc-8b42-b36688cc13e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:55:39.637732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-077181f3-1270-43af-8a51-2bb163f91529 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '.version_select at 0x7f6cf8ee9ee0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:39.733063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-077181f3-1270-43af-8a51-2bb163f91529 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461154313" status: 202 len: 0 microversion: 2.1 time: 0.099162 Jul 16 12:55:39.733657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 340/689] 10.222.0.47 () {58 vars in 1220 bytes} [Sat Jul 16 12:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461154313 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:55:40.201419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:40.201419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:40.201419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:40.201419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:40.201874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:40.201874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:40.371789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:40.381393 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:40.385127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:40.385127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d2ba8a24-ffe4-492e-8eef-eb382a93233b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.207973 Jul 16 12:55:40.385127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 350/690] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:40 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:40.395866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-1fd9b65d-274a-4301-a219-6fd2e5070f97 req-11c70444-1a09-49b0-96fb-d40a74cef5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "name": "network-vif-plugged", "status": "completed", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:40.404943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-1fd9b65d-274a-4301-a219-6fd2e5070f97 req-11c70444-1a09-49b0-96fb-d40a74cef5df service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:40.405417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-1fd9b65d-274a-4301-a219-6fd2e5070f97 req-11c70444-1a09-49b0-96fb-d40a74cef5df service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:40.415694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-1fd9b65d-274a-4301-a219-6fd2e5070f97 req-11c70444-1a09-49b0-96fb-d40a74cef5df service nova] Creating event network-vif-plugged:8a390625-6257-4d3b-a1a4-2f8ae239dbf9 for instance 5b82d74b-e87f-404e-b369-5bd7955f6318 on hv-cinder-83697 Jul 16 12:55:40.420719 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-1fd9b65d-274a-4301-a219-6fd2e5070f97 req-11c70444-1a09-49b0-96fb-d40a74cef5df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029227 Jul 16 12:55:40.421355 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 341/691] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:41.402008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:41.402607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:41.409025 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:41.410110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:41.410880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:41.411306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:41.539680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:41.547659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:41.549338 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:41.550447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-925568ea-2ed2-4e33-ad64-80393461bb12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.152338 Jul 16 12:55:41.551005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 351/692] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:41 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:42.569645 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:42.570277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:42.576379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:42.581131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:42.581131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:42.581131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:42.710180 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:42.718087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:42.719581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:42.720683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ceae2da3-07f5-41ca-b90e-432b157f5598 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1406 microversion: 2.20 time: 0.156747 Jul 16 12:55:42.721273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 342/693] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:42 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:43.124195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:43.124719 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:43.131841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.132282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.133052 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.133484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.157930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:55:43.389654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-82f4aceb-7e88-406c-ac6c-bba9ecada7f0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 204 len: 0 microversion: 2.1 time: 0.269111 Jul 16 12:55:43.390270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 352/694] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:55:43 2022] DELETE /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:55:43.398647 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:43.399262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:43.405228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.405683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.406498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.406884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.548373 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:43.556690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dd0be2a9-0db4-481e-8573-618ce4b796ec tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1509 microversion: 2.1 time: 0.162336 Jul 16 12:55:43.557302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 343/695] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:43 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:43.740364 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:43.740968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:43.746994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.747442 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.748196 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.748630 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.881546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:43.889434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:43.890926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:43.892072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2b080a40-8d8a-4838-b7cf-e038b0a066f3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1599 microversion: 2.20 time: 0.156735 Jul 16 12:55:43.892623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 353/696] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:55:43 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:55:43.909813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:43.910288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:43.917381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.917824 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.918583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:43.919010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:43.997594 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-49036560-f8d9-4bfe-b1e4-915c1fb3974d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091744 Jul 16 12:55:43.998199 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 344/697] 10.222.0.47 () {60 vars in 1315 bytes} [Sat Jul 16 12:55:43 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:55:44.574971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:44.575747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:44.583263 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:44.586602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:44.586602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:44.586602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:44.717907 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:44.721632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:44.725927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bb408343-ac27-44d4-b893-b4ceaa69002b tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1509 microversion: 2.1 time: 0.155356 Jul 16 12:55:44.726499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 354/698] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:44 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:45.216393 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-e38228c3-5c59-4f87-9f68-56243d4098fa req-f7600db8-80fb-49d8-8556-7505d06af46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:45.224935 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e38228c3-5c59-4f87-9f68-56243d4098fa req-f7600db8-80fb-49d8-8556-7505d06af46f service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:45.225643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e38228c3-5c59-4f87-9f68-56243d4098fa req-f7600db8-80fb-49d8-8556-7505d06af46f service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:45.236864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-e38228c3-5c59-4f87-9f68-56243d4098fa req-f7600db8-80fb-49d8-8556-7505d06af46f service nova] Creating event network-changed:8a390625-6257-4d3b-a1a4-2f8ae239dbf9 for instance 5b82d74b-e87f-404e-b369-5bd7955f6318 on hv-cinder-83697 Jul 16 12:55:45.242654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-e38228c3-5c59-4f87-9f68-56243d4098fa req-f7600db8-80fb-49d8-8556-7505d06af46f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030352 Jul 16 12:55:45.243253 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 345/699] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:45.658048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-90d32baf-cf76-4fd4-88d8-0145662cff34 req-820c0eb1-e1e3-421a-bd91-f957d179d3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04ed7dc-6462-48b7-aa58-346840ab65a8", "name": "network-vif-deleted", "tag": "c63f1e2e-a829-45d0-8d47-e9557e8bc915"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:45.673623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-90d32baf-cf76-4fd4-88d8-0145662cff34 req-820c0eb1-e1e3-421a-bd91-f957d179d3fb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:45.674416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-90d32baf-cf76-4fd4-88d8-0145662cff34 req-820c0eb1-e1e3-421a-bd91-f957d179d3fb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:45.710141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-90d32baf-cf76-4fd4-88d8-0145662cff34 req-820c0eb1-e1e3-421a-bd91-f957d179d3fb service nova] Creating event network-vif-deleted:c63f1e2e-a829-45d0-8d47-e9557e8bc915 for instance f04ed7dc-6462-48b7-aa58-346840ab65a8 on hv-cinder-83697 Jul 16 12:55:45.717091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-90d32baf-cf76-4fd4-88d8-0145662cff34 req-820c0eb1-e1e3-421a-bd91-f957d179d3fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062828 Jul 16 12:55:45.718080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 355/700] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:55:45.744062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:45.744993 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:45.757656 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:45.758134 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:45.759102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:45.759577 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:45.868208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:45.878927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-072cd5e3-e19e-4f86-85fe-e3a1cb319475 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 200 len: 1467 microversion: 2.1 time: 0.140011 Jul 16 12:55:45.883208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 346/701] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:45 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 1467 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:46.896975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:46.897659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: f04ed7dc-6462-48b7-aa58-346840ab65a8] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:46.905081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:46.905527 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:46.906307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:46.906732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:46.920450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] HTTP exception thrown: Instance f04ed7dc-6462-48b7-aa58-346840ab65a8 could not be found. Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Request method failure captured: Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 HTTP/1.1 Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAgQ6BYa-iX_hNve8Uc-CRe2aYeOgmDm9JDPJTlq7hkROymxYhIgaGSFyhCoU6Mpn7e_x5tR8kbL6pj7P6_jm7hOCGVtuxQO52nLx9tQJ5CbQOtkIqzWVarD-VaE0opcGZG6M-p6xJipLr3uOCY0BbVVxmpXWi37xxME__L6ta2VE Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:55:46.922676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6e8a673b65b64fbc916da4ce4cdc9f81", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f1c9a7f942c541a287da38a894f1d1f9 Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance f04ed7dc-6462-48b7-aa58-346840ab65a8 could not be found. Jul 16 12:55:46.924329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'f04ed7dc-6462-48b7-aa58-346840ab65a8'} Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04ed7dc-6462-48b7-aa58-346840ab65a8 could not be found. Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:55:46.925174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04ed7dc-6462-48b7-aa58-346840ab65a8 could not be found. Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04ed7dc-6462-48b7-aa58-346840ab65a8 could not be found. Jul 16 12:55:46.927256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:55:46.928533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Returning 404 to user: Instance f04ed7dc-6462-48b7-aa58-346840ab65a8 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:55:46.928533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7525da2f-9720-4742-a77f-f234ebcd6e48 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8" status: 404 len: 111 microversion: 2.1 time: 0.031479 Jul 16 12:55:46.928533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 356/702] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:46 2022] GET /compute/v2.1/servers/f04ed7dc-6462-48b7-aa58-346840ab65a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:55:46.932991 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:46.933571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:46.940064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:46.940536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:46.941326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:46.941801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:46.945867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:55:46.966413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:55:47.275429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2b0f4883-c517-4d36-9ed8-d149e6a5013c tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 204 len: 0 microversion: 2.1 time: 0.346239 Jul 16 12:55:47.276092 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 347/703] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:55:46 2022] DELETE /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:55:47.284560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:47.285211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:47.292157 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:47.292608 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:47.293400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:47.293840 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:47.425736 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 12:55:47.425901 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 12:55:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 12:55:47.426463 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:47.434920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2dcc221e-1e6e-4b0e-91b0-cc11ece406a0 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.154455 Jul 16 12:55:47.435421 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 357/704] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:47 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:48.453349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:48.454184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:48.461602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:48.462240 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:48.463177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:48.463766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:48.595142 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:48.603271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cb75b25f-4671-493a-9f30-99b082862548 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.154212 Jul 16 12:55:48.603831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 348/705] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:48 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:49.620904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:49.621617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:49.628187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:49.628636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:49.629433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:49.629866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:49.760765 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:49.768125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9dfbc154-d665-4e48-bd53-bf0a092fc647 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1521 microversion: 2.1 time: 0.151266 Jul 16 12:55:49.768680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 358/706] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:49 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:50.423038 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-ade669bf-593e-410c-810d-1170b89f65c3 req-c92a66a6-2383-4673-a5f8-d4c473109a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d120daff-ba07-423a-bfed-2b960c4d213e", "name": "network-vif-deleted", "tag": "6abd981f-9fe6-4ec2-b627-c027d25a31e4"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:50.432251 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ade669bf-593e-410c-810d-1170b89f65c3 req-c92a66a6-2383-4673-a5f8-d4c473109a78 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:50.432691 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ade669bf-593e-410c-810d-1170b89f65c3 req-c92a66a6-2383-4673-a5f8-d4c473109a78 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:50.444277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-ade669bf-593e-410c-810d-1170b89f65c3 req-c92a66a6-2383-4673-a5f8-d4c473109a78 service nova] Creating event network-vif-deleted:6abd981f-9fe6-4ec2-b627-c027d25a31e4 for instance d120daff-ba07-423a-bfed-2b960c4d213e on hv-cinder-83697 Jul 16 12:55:50.449061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-ade669bf-593e-410c-810d-1170b89f65c3 req-c92a66a6-2383-4673-a5f8-d4c473109a78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029676 Jul 16 12:55:50.449642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 349/707] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:55:50.785284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:50.785895 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:50.793387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:50.794191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:50.795529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:50.796570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:50.831607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:50.832077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:50.832522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lazy-loading 'fault' on Instance uuid d120daff-ba07-423a-bfed-2b960c4d213e {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:55:50.873236 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c9a7f942c541a287da38a894f1d1f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8a673b65b64fbc916da4ce4cdc9f81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:55:50.881417 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b7b28a5c-1c41-4827-bdac-465769e37680 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 200 len: 1311 microversion: 2.1 time: 0.100082 Jul 16 12:55:50.881979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 359/708] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:50 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:55:51.899604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:55:51.900341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] [instance: d120daff-ba07-423a-bfed-2b960c4d213e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:51.906456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:51.906898 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:51.907646 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:51.908077 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:51.920906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] HTTP exception thrown: Instance d120daff-ba07-423a-bfed-2b960c4d213e could not be found. Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Request method failure captured: Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e HTTP/1.1 Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAgQ6BYa-iX_hNve8Uc-CRe2aYeOgmDm9JDPJTlq7hkROymxYhIgaGSFyhCoU6Mpn7e_x5tR8kbL6pj7P6_jm7hOCGVtuxQO52nLx9tQJ5CbQOtkIqzWVarD-VaE0opcGZG6M-p6xJipLr3uOCY0BbVVxmpXWi37xxME__L6ta2VE Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:55:51.922514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6e8a673b65b64fbc916da4ce4cdc9f81", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6e8a673b65b64fbc916da4ce4cdc9f81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 6e8a673b65b64fbc916da4ce4cdc9f81 Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-690254032 Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: f1c9a7f942c541a287da38a894f1d1f9 Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-ServerRescueNegativeTestJSON-690254032-project Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance d120daff-ba07-423a-bfed-2b960c4d213e could not be found. Jul 16 12:55:51.924178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'd120daff-ba07-423a-bfed-2b960c4d213e'} Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d120daff-ba07-423a-bfed-2b960c4d213e could not be found. Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:55:51.925082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d120daff-ba07-423a-bfed-2b960c4d213e could not be found. Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d120daff-ba07-423a-bfed-2b960c4d213e could not be found. Jul 16 12:55:51.926276 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:55:51.927365 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] Returning 404 to user: Instance d120daff-ba07-423a-bfed-2b960c4d213e could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:55:51.927365 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e0532ca6-565a-41ac-9003-548099e7c171 tempest-ServerRescueNegativeTestJSON-690254032 tempest-ServerRescueNegativeTestJSON-690254032-project] 10.222.0.47 "GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e" status: 404 len: 111 microversion: 2.1 time: 0.029617 Jul 16 12:55:51.927365 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 350/709] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:55:51 2022] GET /compute/v2.1/servers/d120daff-ba07-423a-bfed-2b960c4d213e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:55:58.811333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-319255854"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:58.811892 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:55:58.818016 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:58.819788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:58.819788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:58.819788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:58.952089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.network.security_group_api [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Removing security group 44c770e3-cc75-4be6-8205-59d6f4ffa238 from port c5eda2f4-415c-4056-b687-5a2cd98420ea Jul 16 12:55:59.362783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8b8b1376-cbf2-4243-87dd-3075abcedadc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/action" status: 202 len: 0 microversion: 2.1 time: 0.554886 Jul 16 12:55:59.365740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 360/710] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:55:58 2022] POST /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:55:59.369435 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-adee71b9-14f3-49d5-9a79-d4278a18d01a req-626e3a90-9ac3-4d30-9254-74adb91a6f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:55:59.400387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-adee71b9-14f3-49d5-9a79-d4278a18d01a req-626e3a90-9ac3-4d30-9254-74adb91a6f6c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:55:59.401492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-adee71b9-14f3-49d5-9a79-d4278a18d01a req-626e3a90-9ac3-4d30-9254-74adb91a6f6c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:55:59.439955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-adee71b9-14f3-49d5-9a79-d4278a18d01a req-626e3a90-9ac3-4d30-9254-74adb91a6f6c service nova] Creating event network-changed:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:55:59.447260 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-adee71b9-14f3-49d5-9a79-d4278a18d01a req-626e3a90-9ac3-4d30-9254-74adb91a6f6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083817 Jul 16 12:55:59.454629 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 351/711] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:56:00.989549 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:00.990314 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:00.997412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:00.997865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:00.998661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:00.999107 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:01.085731 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lazy-loading 'services' on Instance uuid 5780acac-cc99-46d0-a4f4-340946e8f74b {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:56:01.274182 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-03a64771-283e-4945-8652-9bfd289e5073 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments/bdc2d091-0b2a-4376-9ab0-5df23c92e2aa" status: 202 len: 0 microversion: 2.1 time: 0.289025 Jul 16 12:56:01.278604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 361/712] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:56:00 2022] DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments/bdc2d091-0b2a-4376-9ab0-5df23c92e2aa => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:56:01.284390 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:01.285787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:01.293093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:01.293465 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:01.294537 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:01.295015 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:01.334306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-692cacba-7cbf-4d00-8a38-827ef4216642 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053330 Jul 16 12:56:01.338473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 352/713] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:56:01 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:01.483633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-fac089c3-f74b-4ed7-ae6d-5d1fd400c8db req-6422e187-05e5-43ad-ae30-01a52f795602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:01.492477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-fac089c3-f74b-4ed7-ae6d-5d1fd400c8db req-6422e187-05e5-43ad-ae30-01a52f795602 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:01.493655 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-fac089c3-f74b-4ed7-ae6d-5d1fd400c8db req-6422e187-05e5-43ad-ae30-01a52f795602 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:01.514131 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-fac089c3-f74b-4ed7-ae6d-5d1fd400c8db req-6422e187-05e5-43ad-ae30-01a52f795602 service nova] Creating event network-changed:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:56:01.522786 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-fac089c3-f74b-4ed7-ae6d-5d1fd400c8db req-6422e187-05e5-43ad-ae30-01a52f795602 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043175 Jul 16 12:56:01.523401 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 362/714] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:02.347400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:02.348434 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:02.359091 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:02.364442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:02.365387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:02.365902 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:02.404177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-16b2d9ae-73e8-471a-af1c-42d60e4dcab5 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062082 Jul 16 12:56:02.404845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 353/715] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:56:02 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:03.417787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:03.418817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:03.425452 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:03.425891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:03.426645 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:03.427076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:03.457365 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b82f316c-4f53-46ae-b410-68fb2fd8d846 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044131 Jul 16 12:56:03.458153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 363/716] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:56:03 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:56:03.469530 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:03.470072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:03.476380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:03.476969 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:03.477953 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:03.478396 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:03.553202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] HTTP exception thrown: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b is not attached to volume bdc2d091-0b2a-4376-9ab0-5df23c92e2aa Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Request method failure captured: Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments/bdc2d091-0b2a-4376-9ab0-5df23c92e2aa HTTP/1.1 Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rRoRym_Tq9YmfYmC_-6unt2orYhhCmdtwcT0mxcTgTWP3Vd9OmkyOTj65P61Dbdl3XXkcWUwQSrcWiDk6hgQLmifHg4pzocbokggdKGsELvp6Xjz_FfaYLA4wIX6dd2n4LX6Rp2W_aIzV4gPNsYpdoNkXFEifvtJ2LiMh3J0L-v8VQ Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: fa16115e6ada4f16874b4f48730bec7f Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-TestMinimumBasicScenario-1216409926 Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:56:03.556281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fa16115e6ada4f16874b4f48730bec7f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa16115e6ada4f16874b4f48730bec7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fa16115e6ada4f16874b4f48730bec7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa16115e6ada4f16874b4f48730bec7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-TestMinimumBasicScenario-1216409926 Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: fa16115e6ada4f16874b4f48730bec7f Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1216409926 Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-TestMinimumBasicScenario-1216409926-project Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 8171d4ef9f644866bb5747a6c31fa5cf Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-TestMinimumBasicScenario-1216409926-project Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:56:03.557724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b is not attached to volume bdc2d091-0b2a-4376-9ab0-5df23c92e2aa Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'server_id': '5780acac-cc99-46d0-a4f4-340946e8f74b', 'id': 'bdc2d091-0b2a-4376-9ab0-5df23c92e2aa'} Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bdc2d091-0b2a-4376-9ab0-5df23c92e2aa. Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:56:03.558598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b is not attached to volume bdc2d091-0b2a-4376-9ab0-5df23c92e2aa Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b is not attached to volume bdc2d091-0b2a-4376-9ab0-5df23c92e2aa Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:03.559968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Returning 404 to user: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b is not attached to volume bdc2d091-0b2a-4376-9ab0-5df23c92e2aa {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:56:03.567613 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b3ba8f64-d1a1-4d40-95a4-62be72b178e6 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments/bdc2d091-0b2a-4376-9ab0-5df23c92e2aa" status: 404 len: 154 microversion: 2.1 time: 0.093274 Jul 16 12:56:03.567613 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 354/717] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:56:03 2022] DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b/os-volume_attachments/bdc2d091-0b2a-4376-9ab0-5df23c92e2aa => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:56:04.846661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:04.847152 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:04.854158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:04.854617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:04.855390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:04.855840 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:04.880317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:56:05.149723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d2145f4a-6ab6-45ab-a3d8-b4754dc90847 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 204 len: 0 microversion: 2.1 time: 0.306693 Jul 16 12:56:05.150362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 364/718] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:56:04 2022] DELETE /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:56:05.158520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:05.163940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:05.165833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:05.166280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:05.167033 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:05.167472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:05.308519 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:05.316087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-76ae1ecf-f092-4790-a73f-606fc0c7652f tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1553 microversion: 2.1 time: 0.161452 Jul 16 12:56:05.316650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 355/719] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:05 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:06.064667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:06.065778 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:06.068089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:06.074148 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.074593 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.075361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.075904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.106955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e26a395f-f664-4efd-95d9-c0e6ef2ab107 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046571 Jul 16 12:56:06.107548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 365/720] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:56:06 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:56:06.166344 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:06.167043 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:06.173733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.174111 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.175060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.175499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.203407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:56:06.334321 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:06.334979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:06.341682 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.342129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.342882 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.343315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.451004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ec744ace-86e4-4dd6-bd7f-97d90e6fa60b tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 204 len: 0 microversion: 2.1 time: 0.288222 Jul 16 12:56:06.452220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 356/721] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:56:06 2022] DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:56:06.460872 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:06.461739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:06.467813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.468389 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.469289 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:06.469827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:06.482060 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:06.489627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-134b5b18-2ab1-4215-b04c-8a45cbaea2cc tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1553 microversion: 2.1 time: 0.159430 Jul 16 12:56:06.494232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 366/722] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:06 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:06.601870 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:06.610945 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e9945939-2f2f-47c5-b80b-b4fb3ec997dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1672 microversion: 2.1 time: 0.154272 Jul 16 12:56:06.611514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 357/723] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:06 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:07.507518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:07.508143 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:07.514849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:07.515530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:07.516121 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:07.516552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:07.628095 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:07.628746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:07.631285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:07.636121 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:07.636572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:07.637364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:07.637792 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:07.653193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:07.660406 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2344f9eb-d422-4dbd-a6e7-550cc7bc729b tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1553 microversion: 2.1 time: 0.156779 Jul 16 12:56:07.660980 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 367/724] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:07 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:07.774892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:07.782430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dc2d089f-8a8f-42b2-a6f7-ffaf32561aaf tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1672 microversion: 2.1 time: 0.158243 Jul 16 12:56:07.788654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 358/725] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:07 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:08.533694 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-2ff1acb3-0d90-4c8e-9a56-228eed0ec7c1 req-8b6ef522-a44a-45bd-8460-fc4ce9779cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5780acac-cc99-46d0-a4f4-340946e8f74b", "name": "network-vif-deleted", "tag": "c5eda2f4-415c-4056-b687-5a2cd98420ea"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:08.543105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-2ff1acb3-0d90-4c8e-9a56-228eed0ec7c1 req-8b6ef522-a44a-45bd-8460-fc4ce9779cee service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:08.543745 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-2ff1acb3-0d90-4c8e-9a56-228eed0ec7c1 req-8b6ef522-a44a-45bd-8460-fc4ce9779cee service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:08.555813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-2ff1acb3-0d90-4c8e-9a56-228eed0ec7c1 req-8b6ef522-a44a-45bd-8460-fc4ce9779cee service nova] Creating event network-vif-deleted:c5eda2f4-415c-4056-b687-5a2cd98420ea for instance 5780acac-cc99-46d0-a4f4-340946e8f74b on hv-cinder-83697 Jul 16 12:56:08.561176 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-2ff1acb3-0d90-4c8e-9a56-228eed0ec7c1 req-8b6ef522-a44a-45bd-8460-fc4ce9779cee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031276 Jul 16 12:56:08.563220 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 368/726] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:08.678421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:08.679100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:08.687472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:08.687915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:08.688681 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:08.689193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:08.751691 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8171d4ef9f644866bb5747a6c31fa5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa16115e6ada4f16874b4f48730bec7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:08.759242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1b3e4a5a-732f-4cf2-9468-7eb454753336 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 200 len: 1343 microversion: 2.1 time: 0.084713 Jul 16 12:56:08.759805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 359/727] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:08 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 1343 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:08.800952 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:08.801802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:08.809689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:08.810780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:08.811879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:08.812441 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:09.052898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:09.060712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-958bbeae-6295-4e73-a7b8-4b42dde94944 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1672 microversion: 2.1 time: 0.264506 Jul 16 12:56:09.061333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 369/728] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:08 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:09.511452 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-9a487576-69c8-4f44-abcf-63e84e26db25 req-a172cbab-a686-4e6a-adfb-aa92d5bd6b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b56c8229-cd52-4255-9f93-6025d9859b44", "name": "network-vif-deleted", "tag": "0d54161e-a36c-4321-a732-74743254790f"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:09.531365 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-9a487576-69c8-4f44-abcf-63e84e26db25 req-a172cbab-a686-4e6a-adfb-aa92d5bd6b7c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:09.535272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-9a487576-69c8-4f44-abcf-63e84e26db25 req-a172cbab-a686-4e6a-adfb-aa92d5bd6b7c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:09.554859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-9a487576-69c8-4f44-abcf-63e84e26db25 req-a172cbab-a686-4e6a-adfb-aa92d5bd6b7c service nova] Creating event network-vif-deleted:0d54161e-a36c-4321-a732-74743254790f for instance b56c8229-cd52-4255-9f93-6025d9859b44 on hv-cinder-83697 Jul 16 12:56:09.561861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-9a487576-69c8-4f44-abcf-63e84e26db25 req-a172cbab-a686-4e6a-adfb-aa92d5bd6b7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056313 Jul 16 12:56:09.562382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 360/729] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:56:09.784715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:09.785824 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] [instance: 5780acac-cc99-46d0-a4f4-340946e8f74b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:09.800560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:09.800560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:09.800560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:09.800560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:09.820348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] HTTP exception thrown: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b could not be found. Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Request method failure captured: Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b HTTP/1.1 Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rRoRym_Tq9YmfYmC_-6unt2orYhhCmdtwcT0mxcTgTWP3Vd9OmkyOTj65P61Dbdl3XXkcWUwQSrcWiDk6hgQLmifHg4pzocbokggdKGsELvp6Xjz_FfaYLA4wIX6dd2n4LX6Rp2W_aIzV4gPNsYpdoNkXFEifvtJ2LiMh3J0L-v8VQ Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: fa16115e6ada4f16874b4f48730bec7f Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-TestMinimumBasicScenario-1216409926 Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:56:09.822590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_fa16115e6ada4f16874b4f48730bec7f", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa16115e6ada4f16874b4f48730bec7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/fa16115e6ada4f16874b4f48730bec7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/fa16115e6ada4f16874b4f48730bec7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-TestMinimumBasicScenario-1216409926 Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: fa16115e6ada4f16874b4f48730bec7f Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1216409926 Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-TestMinimumBasicScenario-1216409926-project Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 8171d4ef9f644866bb5747a6c31fa5cf Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-TestMinimumBasicScenario-1216409926-project Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b could not be found. Jul 16 12:56:09.823905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '5780acac-cc99-46d0-a4f4-340946e8f74b'} Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b could not be found. Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:56:09.824628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b could not be found. Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b could not be found. Jul 16 12:56:09.829880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:56:09.830918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Returning 404 to user: Instance 5780acac-cc99-46d0-a4f4-340946e8f74b could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:56:09.830918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f900fc14-8419-4962-bee9-7cab40f7f675 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b" status: 404 len: 111 microversion: 2.1 time: 0.048990 Jul 16 12:56:09.830918 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 370/730] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:09 2022] GET /compute/v2.1/servers/5780acac-cc99-46d0-a4f4-340946e8f74b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:56:09.840088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ab619d84-fbe9-4f67-8180-76090bd07263 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] Calling method '.version_select at 0x7f6cf8ee99d0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:09.908473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ab619d84-fbe9-4f67-8180-76090bd07263 tempest-TestMinimumBasicScenario-1216409926 tempest-TestMinimumBasicScenario-1216409926-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2010400740" status: 202 len: 0 microversion: 2.1 time: 0.075659 Jul 16 12:56:09.909266 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 361/731] 10.222.0.47 () {58 vars in 1271 bytes} [Sat Jul 16 12:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2010400740 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:56:10.082117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:10.082117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:10.093455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:10.094380 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:10.095360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:10.096282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:10.131450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:10.131992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:10.132407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lazy-loading 'fault' on Instance uuid b56c8229-cd52-4255-9f93-6025d9859b44 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:56:10.185886 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:10.193811 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e86ff02c-8b3b-4a5c-b3f5-213db0049d90 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 200 len: 1327 microversion: 2.1 time: 0.119319 Jul 16 12:56:10.194385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 371/732] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:10 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:11.222805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:11.223558 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:11.231203 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:11.231654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:11.232415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:11.232847 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:11.246084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] HTTP exception thrown: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Request method failure captured: Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 HTTP/1.1 Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO_f6ehHzpmBZSBrYY1MJXhKDhrQf3w8ibGZ2GOcNsdI71Xw0m8jRfqvFK5LW4j28SNCKCJqi6fkmdf10vlzPYw0u5QFpuGWbZXrBP1Kck6sIw6pUA_UIF45t_r_dsaFUOf1yK1GxK2IRQHO6DnrEeU9L2MwMyFhsoDhWrHTqSlfsY Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:56:11.247683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_858d6855277f465497c27313765e5d1a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/858d6855277f465497c27313765e5d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 46b5c80d8bf34965a30b9b67e9117996 Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:56:11.249404 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'b56c8229-cd52-4255-9f93-6025d9859b44'} Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:56:11.250801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:56:11.252288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:56:11.253668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Returning 404 to user: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:56:11.253668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-22bff688-3d83-4b34-ad2a-98df5b25a557 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 404 len: 111 microversion: 2.1 time: 0.030184 Jul 16 12:56:11.253668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 362/733] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:11 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:56:11.258406 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6e3f67db-66b2-436f-b7db-825aae34d18c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '.version_select at 0x7f6cf8e498b0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:11.357016 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6e3f67db-66b2-436f-b7db-825aae34d18c tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212866917" status: 202 len: 0 microversion: 2.1 time: 0.102468 Jul 16 12:56:11.357576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 372/734] 10.222.0.47 () {58 vars in 1220 bytes} [Sat Jul 16 12:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1212866917 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:56:12.429861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-65a06306-45d3-4683-ba3e-87115242acf5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: .version_select at 0x7f6cf8bb3550>, body: {"keypair": {"name": "tempest-keypair-2017371057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI+xIPmP78Z3uB7qf5Gy/bwRidfWODwhXc3ygoIh8gCQ1j5utFI8igXGKt3plP4nCEZiBxdg5HkQBmJ5Lkljs0Y3m6SzTcVdvk+i8a3dDDbDAJjTiqadVfIp3oxys+lbQ=="}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:12.444764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-65a06306-45d3-4683-ba3e-87115242acf5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for project 858d6855277f465497c27313765e5d1a. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:56:12.449285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-65a06306-45d3-4683-ba3e-87115242acf5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for user 46b5c80d8bf34965a30b9b67e9117996 and project 858d6855277f465497c27313765e5d1a. Resources: {'key_pairs'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:56:12.531397 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-65a06306-45d3-4683-ba3e-87115242acf5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105663 Jul 16 12:56:12.532004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 363/735] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:56:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:15.262783 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1296927696", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e589d6d-dffd-4d85-b847-b143776bf015"}], "security_groups": [{"name": "tempest-securitygroup--1191587432"}], "key_name": "tempest-keypair-2017371057", "user_data": "}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:15.385397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] validate_networks() for [('2e589d6d-dffd-4d85-b847-b143776bf015', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:56:15.859450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:56:15.859961 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:56:15.860759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:56:15.861366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:56:15.864717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:56:15.871558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:15.872013 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:15.872813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:15.873324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:15.880489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:15.891997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for project 858d6855277f465497c27313765e5d1a. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:56:15.896069 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Getting quotas for user 46b5c80d8bf34965a30b9b67e9117996 and project 858d6855277f465497c27313765e5d1a. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:56:15.907395 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:56:15.909797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:56:16.031187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f57b97f4-d643-4d6d-80ac-c62508655226 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.773315 Jul 16 12:56:16.031828 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 373/736] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:56:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:56:16.043458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ffdd7307-280a-42ab-beb4-b091b194d845 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:16.044864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ffdd7307-280a-42ab-beb4-b091b194d845 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:16.135126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ffdd7307-280a-42ab-beb4-b091b194d845 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:16.144408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ffdd7307-280a-42ab-beb4-b091b194d845 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1238 microversion: 2.1 time: 0.106234 Jul 16 12:56:16.144950 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 364/737] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:16 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:17.164590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:17.165277 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:17.186607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:17.187261 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:17.188373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:17.189223 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:17.267345 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:17.274972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c3c43916-c8c7-48c4-bd0d-cfc7888ce84f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1242 microversion: 2.1 time: 0.116872 Jul 16 12:56:17.275540 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 374/738] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:17 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:18.294110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:18.294110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:18.301743 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:18.302196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:18.302975 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:18.303409 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:18.306599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:18.373552 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:18.385895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-52c5543a-2801-48ce-a876-50099bbbbe34 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1298 microversion: 2.1 time: 0.092988 Jul 16 12:56:18.385895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 365/739] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:18 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:19.398864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:19.400132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:19.415759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:19.416332 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:19.418703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:19.418703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:19.608171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:19.617876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ce95b456-a360-4a50-a48a-fa8dae36be3a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1296 microversion: 2.1 time: 0.223317 Jul 16 12:56:19.628821 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 375/740] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:19 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1296 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:20.636116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:20.637375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:20.651286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:20.653398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:20.653537 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:20.654151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:20.813876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-e0395b7c-6efa-42ab-b7e0-6683d6c47319 req-4820bf34-b64c-4ac8-9799-74a97e3c18ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb2122a2-18d0-4d75-a803-f0c59b035e7b", "tag": "c21200de-2f15-4e22-b9dc-a6e7ef0bd20d"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:20.833108 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-e0395b7c-6efa-42ab-b7e0-6683d6c47319 req-4820bf34-b64c-4ac8-9799-74a97e3c18ec service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:20.834130 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-e0395b7c-6efa-42ab-b7e0-6683d6c47319 req-4820bf34-b64c-4ac8-9799-74a97e3c18ec service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:20.855606 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-e0395b7c-6efa-42ab-b7e0-6683d6c47319 req-4820bf34-b64c-4ac8-9799-74a97e3c18ec service nova] Creating event network-changed:c21200de-2f15-4e22-b9dc-a6e7ef0bd20d for instance fb2122a2-18d0-4d75-a803-f0c59b035e7b on hv-cinder-83697 Jul 16 12:56:20.872971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-e0395b7c-6efa-42ab-b7e0-6683d6c47319 req-4820bf34-b64c-4ac8-9799-74a97e3c18ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062091 Jul 16 12:56:20.874292 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 376/741] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:56:20.987776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:21.000960 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1ef57836-0e8d-4e0f-bb92-e2ebf9333c56 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.369056 Jul 16 12:56:21.019131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 366/742] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:20 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:22.031097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:22.031790 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:22.037997 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:22.038444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:22.041572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:22.042992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:22.186653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:22.194193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d5c48f35-5c67-47a4-a2a9-869b7dc585a9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.168273 Jul 16 12:56:22.194753 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 377/743] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:22 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:23.211462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:23.212144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:23.226334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:23.226334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:23.226334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:23.226334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:23.357977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:23.365312 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c5937011-0df4-4d25-9520-1730481c7d59 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.157640 Jul 16 12:56:23.365864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 367/744] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:23 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:24.383023 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:24.383762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:24.390724 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:24.391401 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:24.392346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:24.392941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:24.539328 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:24.547296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f091d61b-352d-4290-976e-ad2ce2b1e57e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.168060 Jul 16 12:56:24.547866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 378/745] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:24 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:25.564119 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:25.564725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:25.571083 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:25.572802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:25.572802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:25.572802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:25.733805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:25.741456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6f01da12-a84f-4843-9fea-30fe65ec87f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.181129 Jul 16 12:56:25.742028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 368/746] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:25 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:26.504876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:26.505497 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:26.507808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:26.509983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:26.515382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:26.515832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:26.516776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:26.517247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:26.540830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lazy-loading 'flavor' on Instance uuid e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:56:26.758287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:26.758843 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:26.760667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:26.766607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:26.767069 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:26.767844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:26.768288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:26.881281 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7e3987ac-a483-4ae2-8dc6-644e77cbbcb8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "POST /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2/action" status: 202 len: 0 microversion: 2.1 time: 0.380373 Jul 16 12:56:26.881879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 379/747] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:56:26 2022] POST /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:56:26.891348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:26.892048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:26.898510 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:26.901769 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:26.901922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:26.903043 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:26.904221 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:26.913684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b3c0d943-fd9f-48fe-b217-0cb1471bc4c9 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.159141 Jul 16 12:56:26.914375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 369/748] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:26 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:27.047475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:27.056091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bced9ced-821d-421d-8771-52fe9ebc3b4e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.169755 Jul 16 12:56:27.057092 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 380/749] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:26 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:27.931160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:27.931784 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:27.939102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:27.939669 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:27.940472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:27.940916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:28.075605 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:28.076256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:28.082664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:28.084174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:28.084634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:28.085450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:28.085944 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:28.090292 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e440ebdb-262f-4ff2-99e3-04115a7036d2 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.163476 Jul 16 12:56:28.090936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 370/750] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:27 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:28.226051 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:28.234368 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5e3300f9-b2a5-4ed6-8229-2e2b080fb099 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.163336 Jul 16 12:56:28.234939 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 381/751] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:28 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:28.517015 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-53c9642a-6d5c-4c28-833a-5b56b15bc903 req-4738017c-71e1-4a71-b081-7e937e3d3603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb2122a2-18d0-4d75-a803-f0c59b035e7b", "name": "network-vif-plugged", "status": "completed", "tag": "c21200de-2f15-4e22-b9dc-a6e7ef0bd20d"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:28.525017 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-53c9642a-6d5c-4c28-833a-5b56b15bc903 req-4738017c-71e1-4a71-b081-7e937e3d3603 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:28.525483 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-53c9642a-6d5c-4c28-833a-5b56b15bc903 req-4738017c-71e1-4a71-b081-7e937e3d3603 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:28.536435 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-53c9642a-6d5c-4c28-833a-5b56b15bc903 req-4738017c-71e1-4a71-b081-7e937e3d3603 service nova] Creating event network-vif-plugged:c21200de-2f15-4e22-b9dc-a6e7ef0bd20d for instance fb2122a2-18d0-4d75-a803-f0c59b035e7b on hv-cinder-83697 Jul 16 12:56:28.541514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-53c9642a-6d5c-4c28-833a-5b56b15bc903 req-4738017c-71e1-4a71-b081-7e937e3d3603 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028284 Jul 16 12:56:28.542092 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 371/752] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:29.108614 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:29.109174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:29.115328 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:29.115775 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:29.116583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:29.117022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:29.250567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:29.252831 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:29.254338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:29.258698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d5482028-34ba-4925-964c-883e398838dd tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.154838 Jul 16 12:56:29.259365 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 382/753] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:29 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:29.259977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:29.260429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:29.261226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:29.261666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:29.398594 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:29.406585 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-eed063d5-8964-4285-9076-8f98e88c23f9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.158749 Jul 16 12:56:29.407136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 372/754] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:29 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:30.275837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:30.276451 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:30.285090 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:30.285542 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:30.286345 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:30.286753 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:30.424160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:30.424769 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:30.425490 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:30.432282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:30.432616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-164d08f0-9a9b-4160-a0fe-7593bb9a6e5d tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1364 microversion: 2.1 time: 0.160580 Jul 16 12:56:30.432731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:30.433391 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 383/755] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:30 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:30.433519 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:30.434018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:30.569399 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:30.577263 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b650f31e-fe04-4622-adb0-740c4371bce4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.158055 Jul 16 12:56:30.577824 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 373/756] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:30 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:31.450413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:31.451052 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:31.458700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:31.459142 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:31.459903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:31.460378 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:31.594553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:31.595179 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:31.602381 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:31.602660 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:31.603120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:31.603955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:31.604400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:31.610922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-83fbfac6-40d4-4bc7-9512-eb9795f3c872 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1550 microversion: 2.1 time: 0.164324 Jul 16 12:56:31.611495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 384/757] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:31 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:31.628401 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:31.631798 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:31.635118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:31.635572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:31.636339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:31.636777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:31.716529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c6b27837-bc66-4e2f-a138-04fe686ca7f5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091917 Jul 16 12:56:31.717856 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 385/758] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:56:31 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:56:31.742144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:31.750189 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6b35040c-e3e6-4c5c-bd25-bc88c679027e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.159889 Jul 16 12:56:31.750764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 374/759] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:31 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:32.722011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-11c45c2c-3549-426c-be87-b459b827cdc1 req-2c754a0a-f2a2-4769-a601-79d8fc8dfcdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb2122a2-18d0-4d75-a803-f0c59b035e7b", "tag": "c21200de-2f15-4e22-b9dc-a6e7ef0bd20d"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:32.730167 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-11c45c2c-3549-426c-be87-b459b827cdc1 req-2c754a0a-f2a2-4769-a601-79d8fc8dfcdc service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:32.730678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-11c45c2c-3549-426c-be87-b459b827cdc1 req-2c754a0a-f2a2-4769-a601-79d8fc8dfcdc service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:32.742416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-11c45c2c-3549-426c-be87-b459b827cdc1 req-2c754a0a-f2a2-4769-a601-79d8fc8dfcdc service nova] Creating event network-changed:c21200de-2f15-4e22-b9dc-a6e7ef0bd20d for instance fb2122a2-18d0-4d75-a803-f0c59b035e7b on hv-cinder-83697 Jul 16 12:56:32.747375 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-11c45c2c-3549-426c-be87-b459b827cdc1 req-2c754a0a-f2a2-4769-a601-79d8fc8dfcdc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030458 Jul 16 12:56:32.748118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 386/760] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:32.769108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:32.769865 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:32.776580 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:32.777020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:32.778075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:32.778500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:32.919182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:32.928337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e0dd47f7-0d9d-41d3-8c07-94874c8c6bf4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.164835 Jul 16 12:56:32.929169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 375/761] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:32 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:33.949476 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:33.953676 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:33.956571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:33.957021 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:33.957813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:33.958247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:34.096814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:34.104453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d0bda9d4-fee7-4a6d-858c-e002019a299a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.161503 Jul 16 12:56:34.105018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 387/762] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:33 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:35.121723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:35.122335 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:35.129770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:35.130210 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:35.130967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:35.131408 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:35.269334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:35.277554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-37fdd8cc-5b2c-43eb-83c3-bc2d1c1e3b1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.159752 Jul 16 12:56:35.278126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 376/763] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:35 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:36.293933 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:36.294549 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:36.301129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:36.301579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:36.302339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:36.302773 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:36.435416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:36.446654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7d140ad4-2582-4406-a1b2-451528e525cb tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.153723 Jul 16 12:56:36.446654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 388/764] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:36 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:37.462520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:37.463364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:37.470897 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:37.472046 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:37.472278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:37.472711 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:37.616849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:37.625896 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-12b70be0-9f8a-4d0f-85e2-6f53248b6e10 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.167459 Jul 16 12:56:37.626459 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 377/765] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:37 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:38.642851 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:38.643445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:38.646047 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:38.650763 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:38.651203 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:38.651957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:38.652389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:38.781924 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:38.789517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-317bbcc3-918a-4428-82c2-a1bdc9eb8f07 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.150429 Jul 16 12:56:38.790082 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 389/766] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:38 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:39.807949 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:39.808572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:39.811364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:39.816294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:39.816745 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:39.817551 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:39.818018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:39.954224 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:39.961688 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-172571aa-a54e-4095-9205-88348ed611df tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.157883 Jul 16 12:56:39.962253 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 378/767] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:39 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:40.978487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:40.979098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:40.986227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:40.986681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:40.987439 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:40.987872 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:40.992791 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:41.122066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:41.130401 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c96c3634-b5a9-4353-979e-3522d7fd20e1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1508 microversion: 2.1 time: 0.155707 Jul 16 12:56:41.130910 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 390/768] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:40 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:41.146651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:41.147337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:41.154415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:41.154955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:41.155705 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:41.156131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:41.477031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a1af5023-0beb-4405-9f84-fa822159e6ed tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "POST /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2/action" status: 202 len: 0 microversion: 2.1 time: 0.333935 Jul 16 12:56:41.477599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 379/769] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 12:56:41 2022] POST /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:56:41.487221 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:41.487829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:41.493979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:41.494615 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:41.495374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:41.495807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:41.631161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:41.640653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3ddab2e5-967e-4c8f-9e3d-c73142b5519c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1516 microversion: 2.1 time: 0.158610 Jul 16 12:56:41.641261 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 391/770] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:41 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:42.659374 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:42.659991 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:42.666726 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:42.667204 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:42.670597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:42.670597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:42.808099 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:42.814328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9315e2f0-0fdb-434a-94cb-0d6d4c23f27a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1518 microversion: 2.1 time: 0.158886 Jul 16 12:56:42.814902 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 380/771] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:42 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:43.836382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:43.836989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:43.844134 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:43.844586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:43.845598 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:43.846038 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:43.985278 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:43.993359 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7ff78242-64f3-4e2c-a01f-20147a5f430c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1518 microversion: 2.1 time: 0.161491 Jul 16 12:56:43.997556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 392/772] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:43 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:44.449515 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-e9881099-0825-4437-aa3d-4a03291a2872 req-ca5f46cc-927f-46f1-9a9e-f51a374c563c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "name": "network-vif-unplugged", "status": "completed", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:44.459173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e9881099-0825-4437-aa3d-4a03291a2872 req-ca5f46cc-927f-46f1-9a9e-f51a374c563c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:44.459620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-e9881099-0825-4437-aa3d-4a03291a2872 req-ca5f46cc-927f-46f1-9a9e-f51a374c563c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:44.471313 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-e9881099-0825-4437-aa3d-4a03291a2872 req-ca5f46cc-927f-46f1-9a9e-f51a374c563c service nova] Creating event network-vif-unplugged:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 12:56:44.476283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-e9881099-0825-4437-aa3d-4a03291a2872 req-ca5f46cc-927f-46f1-9a9e-f51a374c563c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030473 Jul 16 12:56:44.476849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 381/773] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:45.015789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:45.016404 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:45.022836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:45.023279 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:45.024126 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:45.024702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:45.268326 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:45.277978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fb6d96f6-0b6b-43e0-8efe-49436e9f4d1a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.270620 Jul 16 12:56:45.279902 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 393/774] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:45 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:46.296231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:46.296938 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:46.303848 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:46.304300 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:46.305351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:46.305792 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:46.308456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:56:46.441674 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:46.448991 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-27f3f06f-40e1-4817-9d6a-96d5623754fd tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.157084 Jul 16 12:56:46.449835 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 382/775] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:46 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:47.466844 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:47.467451 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:47.474855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:47.476306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:47.476306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:47.476498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:47.610082 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:47.617716 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1affa43d-500a-4c2e-8dbe-032dfbe224fe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.154529 Jul 16 12:56:47.618222 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 394/776] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:47 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:48.635201 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:48.635821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:48.642648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:48.643111 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:48.644443 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:48.644443 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:48.778157 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:48.786836 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-85db2f37-5984-4390-93cc-5ce9e96afed1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.155967 Jul 16 12:56:48.787506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 383/777] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:48 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:49.803851 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:49.804382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:49.811411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:49.811852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:49.813793 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:49.814230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:49.949329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:49.956916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-787c6cde-7640-4d12-9501-74457bc3f4ee tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.157088 Jul 16 12:56:49.957503 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 395/778] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:49 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:50.973716 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:50.974355 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:50.980787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:50.981273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:50.982037 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:50.982474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:51.111445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:51.118964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a1469aaa-1f5f-4f9b-9909-7c253b121a8f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.149116 Jul 16 12:56:51.119778 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 384/779] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:50 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:51.485086 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:51.485630 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:51.491973 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:51.492418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:51.493210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:51.493645 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:51.516525 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e956410d-11f1-4d92-bbca-b6ed068301b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/ips" status: 200 len: 150 microversion: 2.1 time: 0.035957 Jul 16 12:56:51.517110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 396/780] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:56:51 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:56:52.135759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:52.136377 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:52.143842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:52.144291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:52.145058 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:52.145508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:52.284266 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:52.292004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7a8965c4-5846-4505-b727-bb9e8e221ca4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.160276 Jul 16 12:56:52.292568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 385/781] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:52 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:53.309789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:53.310362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:53.316766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:53.317260 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:53.318008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:53.318439 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:53.449026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:53.456947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6397f243-6b2a-43a2-a159-8ff2f5dede62 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.151070 Jul 16 12:56:53.457539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 397/782] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:53 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:56:54.142449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "849588eb-e48a-4fe9-8644-22222ca2a181"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:56:54.143517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:54.150108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:54.150671 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:54.151468 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:54.151906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:54.474111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:54.474750 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:54.481189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:54.481632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:54.482376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:54.482801 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:54.618337 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:54.626938 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8517a0a8-99ee-4799-b86b-90654270b1ab tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.156723 Jul 16 12:56:54.627531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 398/783] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:54 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:55.644955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:55.645670 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:55.651558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:55.651988 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:55.652741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:55.653207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:55.783455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:55.790905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e26e3fba-7a4a-4724-b163-3c05309f3af4 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.150407 Jul 16 12:56:55.791472 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 399/784] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:55 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:56.807875 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:56.808537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:56.815259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:56.815709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:56.816477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:56.816916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:56.947305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:56.955490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d8c9e3e2-5caf-462b-b702-6cfc8471223a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.151709 Jul 16 12:56:56.956058 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 400/785] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:56 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:57.972687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:57.973353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:57.979671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:57.980406 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:57.980854 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:57.981312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:58.118953 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:58.126638 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-78157987-0385-42fa-af7e-549da19af425 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.158458 Jul 16 12:56:58.127417 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 401/786] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:57 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:56:58.985428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9efcd9eb-a80a-418e-8bf4-dbb5efb596b9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.847644 Jul 16 12:56:58.985988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 386/787] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:56:54 2022] POST /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments => generated 194 bytes in 4849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:56:59.143867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:56:59.144482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:56:59.151123 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:59.151564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:59.152320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:56:59.152751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:56:59.294861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:56:59.303348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8e86b082-9ba9-45c4-b2fd-9491914214d9 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.163867 Jul 16 12:56:59.303920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 402/788] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:56:59 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:00.321862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:00.323258 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:00.330563 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:00.330924 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:00.331704 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:00.332143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:00.467183 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:00.477470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cf14a38e-ec30-4d3b-894e-e63e6ad77a1c tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1574 microversion: 2.1 time: 0.157872 Jul 16 12:57:00.477470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 387/789] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:00 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:00.897735 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-5e40cc1b-bc50-4ff8-a0c8-75fac9844907 req-4e9e8807-a5fc-4409-affb-d1cfab76ef35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "name": "network-vif-plugged", "status": "completed", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:00.906268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-5e40cc1b-bc50-4ff8-a0c8-75fac9844907 req-4e9e8807-a5fc-4409-affb-d1cfab76ef35 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:00.906698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-5e40cc1b-bc50-4ff8-a0c8-75fac9844907 req-4e9e8807-a5fc-4409-affb-d1cfab76ef35 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:00.917963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-5e40cc1b-bc50-4ff8-a0c8-75fac9844907 req-4e9e8807-a5fc-4409-affb-d1cfab76ef35 service nova] Creating event network-vif-plugged:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 12:57:00.923168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-5e40cc1b-bc50-4ff8-a0c8-75fac9844907 req-4e9e8807-a5fc-4409-affb-d1cfab76ef35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029829 Jul 16 12:57:00.924457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 403/790] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:01.494425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:01.494972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:01.501638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:01.502747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:01.503511 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:01.503944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:01.648499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:01.656304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-95644b4c-d1b5-4ffe-a1d6-6ecb4580e2b8 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1561 microversion: 2.1 time: 0.166857 Jul 16 12:57:01.656882 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 388/791] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:01 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 12:57:08.580003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "849588eb-e48a-4fe9-8644-22222ca2a181"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:08.581599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:08.587636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:08.588080 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:08.588836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:08.589290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:08.668139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Invalid volume: volume 849588eb-e48a-4fe9-8644-22222ca2a181 is already attached to instances: 87b69d9d-a0a8-472f-86da-9608601291a3 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: POST /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments HTTP/1.1 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 74 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:57:08.670132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {"volumeAttachment": {"volumeId": "849588eb-e48a-4fe9-8644-22222ca2a181"}} Jul 16 12:57:08.671734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Invalid volume: volume 849588eb-e48a-4fe9-8644-22222ca2a181 is already attached to instances: 87b69d9d-a0a8-472f-86da-9608601291a3 Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'server_id': '87b69d9d-a0a8-472f-86da-9608601291a3', 'body': {'volumeAttachment': {'volumeId': '849588eb-e48a-4fe9-8644-22222ca2a181'}}} Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 849588eb-e48a-4fe9-8644-22222ca2a181 is already attached to instances: 87b69d9d-a0a8-472f-86da-9608601291a3 Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:08.672647 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 849588eb-e48a-4fe9-8644-22222ca2a181 is already attached to instances: 87b69d9d-a0a8-472f-86da-9608601291a3 Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:57:08.673880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 849588eb-e48a-4fe9-8644-22222ca2a181 is already attached to instances: 87b69d9d-a0a8-472f-86da-9608601291a3 Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 400 to user: Invalid volume: volume 849588eb-e48a-4fe9-8644-22222ca2a181 is already attached to instances: 87b69d9d-a0a8-472f-86da-9608601291a3 {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-373133d2-20c1-443a-aefa-f5b590929b49 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096465 Jul 16 12:57:08.675998 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 404/792] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:57:08 2022] POST /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:57:08.743956 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:08.746587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:08.751361 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:08.751806 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:08.753405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:08.753849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:08.834440 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lazy-loading 'services' on Instance uuid 87b69d9d-a0a8-472f-86da-9608601291a3 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:57:09.063855 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4aa1da08-ce3e-4fa4-a479-892b30ccb41d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments/849588eb-e48a-4fe9-8644-22222ca2a181" status: 202 len: 0 microversion: 2.1 time: 0.323531 Jul 16 12:57:09.064369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 389/793] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:57:08 2022] DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments/849588eb-e48a-4fe9-8644-22222ca2a181 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:57:09.072945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:09.074099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:09.076069 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=32 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:09.081876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:09.082326 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:09.083124 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:09.083561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:09.112887 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-56c13a52-cfc6-4a71-b96e-f5c7eac7ffdd tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Jul 16 12:57:09.113566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 405/794] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:57:09 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:10.126213 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:10.127237 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:10.134380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:10.134863 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:10.135636 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:10.136124 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:10.165187 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fbb38e7a-3b7e-4323-9490-c1172d7bf677 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Jul 16 12:57:10.166041 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 390/795] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:57:10 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:11.180268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:11.181484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:11.188607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:11.189156 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:11.190190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:11.190844 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:11.220360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d686bfc2-080f-4888-aab8-0bf858e28add tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047634 Jul 16 12:57:11.221523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 406/796] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:57:11 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:12.235513 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:12.237830 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:12.241936 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=28 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:12.247846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:12.248327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:12.249153 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:12.249624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:12.279987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3e0c4562-c888-427a-99b6-3dda634f4125 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051384 Jul 16 12:57:12.280699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 391/797] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:57:12 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:57:12.345203 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:12.345827 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:12.352950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:12.353422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:12.354174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:12.354603 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:12.357354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=95 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:12.380977 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:57:12.710477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ec91d215-900e-4f67-bdc1-afcf16622d36 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 204 len: 0 microversion: 2.1 time: 0.368863 Jul 16 12:57:12.711257 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 407/798] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:57:12 2022] DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:57:12.720039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:12.720657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:12.727425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:12.731177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:12.731177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:12.731177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:12.859396 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:12.867792 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3a85df06-2bd2-4fe1-a071-a66c3ff74026 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1683 microversion: 2.1 time: 0.152072 Jul 16 12:57:12.868358 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 392/799] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:12 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:13.885619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:13.886315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:13.893477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:13.893955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:13.894712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:13.895159 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:14.030038 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:14.038619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f5956cf2-360b-4389-87ae-f1ff5ae7648e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1683 microversion: 2.1 time: 0.157349 Jul 16 12:57:14.039283 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 408/800] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:13 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:15.056475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:15.057114 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:15.063426 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:15.063875 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:15.064679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:15.065228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:15.196430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:15.204020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c52e494b-ed69-46b2-b46d-076187656a3e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1683 microversion: 2.1 time: 0.151649 Jul 16 12:57:15.214836 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 393/801] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:15 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:15.693351 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-be3c1301-a5aa-4412-91be-a11d0e647667 req-c78e0d7e-6a7d-4473-8ebd-2d01dbcc8fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b69d9d-a0a8-472f-86da-9608601291a3", "name": "network-vif-deleted", "tag": "47f7f08d-df06-425a-b07d-43b67a538d9c"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:15.703837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-be3c1301-a5aa-4412-91be-a11d0e647667 req-c78e0d7e-6a7d-4473-8ebd-2d01dbcc8fdc service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:15.704421 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-be3c1301-a5aa-4412-91be-a11d0e647667 req-c78e0d7e-6a7d-4473-8ebd-2d01dbcc8fdc service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:15.717356 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-be3c1301-a5aa-4412-91be-a11d0e647667 req-c78e0d7e-6a7d-4473-8ebd-2d01dbcc8fdc service nova] Creating event network-vif-deleted:47f7f08d-df06-425a-b07d-43b67a538d9c for instance 87b69d9d-a0a8-472f-86da-9608601291a3 on hv-cinder-83697 Jul 16 12:57:15.724056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-be3c1301-a5aa-4412-91be-a11d0e647667 req-c78e0d7e-6a7d-4473-8ebd-2d01dbcc8fdc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 Jul 16 12:57:15.725463 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 409/802] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:16.221967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:16.222582 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:16.229327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:16.229774 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:16.230536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:16.230967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:16.264965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:16.265441 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:16.266572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lazy-loading 'fault' on Instance uuid 87b69d9d-a0a8-472f-86da-9608601291a3 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:57:16.328933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:16.339642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-30e8468a-e1a0-44a9-8658-4ce40bbb438e tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 200 len: 1332 microversion: 2.1 time: 0.121581 Jul 16 12:57:16.348472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 394/803] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:16 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 1332 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:17.357947 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:17.358634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:17.365756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:17.366512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:17.367278 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:17.367710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:17.380756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 HTTP/1.1 Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:57:17.386589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:57:17.388205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '87b69d9d-a0a8-472f-86da-9608601291a3'} Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:57:17.389150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:57:17.390681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:57:17.392004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:57:17.392004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-576bffd7-5471-4220-9421-6bd362907dcb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 404 len: 111 microversion: 2.1 time: 0.034699 Jul 16 12:57:17.392004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 410/804] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:17 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:57:17.397570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-029582cd-e1c0-43b8-b708-d98f327711b0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '.version_select at 0x7f6cf8bc7c10>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:17.505956 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-029582cd-e1c0-43b8-b708-d98f327711b0 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514140658" status: 202 len: 0 microversion: 2.1 time: 0.112480 Jul 16 12:57:17.506464 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 395/805] 10.222.0.47 () {58 vars in 1220 bytes} [Sat Jul 16 12:57:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1514140658 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 16 12:57:18.245738 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3d0da2ee-4752-4ed2-89d8-2a98fdaf1cad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: .version_select at 0x7f6cf8cd18b0>, body: {"keypair": {"name": "tempest-keypair-626859795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYWVZR3G9OoQ8PRG+RH+v9ywLwR4qhRr/566sq+5CKxFE5RYDALwzb0qLJH3Xv7zqYPKQHXWr4DNJTzPj9FmmSVP9MrMFeMkHI5wo2nFbkKe2/k8MVGx/SN2jQgXiAWtQ=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:18.259539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-3d0da2ee-4752-4ed2-89d8-2a98fdaf1cad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:57:18.263329 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-3d0da2ee-4752-4ed2-89d8-2a98fdaf1cad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:57:18.370259 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3d0da2ee-4752-4ed2-89d8-2a98fdaf1cad tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128399 Jul 16 12:57:18.371192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 411/806] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 12:57:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:20.528830 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2031181312", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a354d703-6ba1-41fe-886d-bd8338eb5858"}], "security_groups": [{"name": "tempest-securitygroup--545728484"}], "key_name": "tempest-keypair-626859795", "user_data": "}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:20.632402 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] validate_networks() for [('a354d703-6ba1-41fe-886d-bd8338eb5858', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 12:57:20.995888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 12:57:20.996310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 12:57:20.996780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 12:57:20.997228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 12:57:20.997636 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 12:57:21.006918 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:21.007360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:21.008141 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:21.008570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:21.015078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:21.026045 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 12:57:21.029982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Getting quotas for user 628e662a3b49438f9930a2d160658b7c and project a3bb5db6207441a1b5030af42f291666. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 12:57:21.040814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 12:57:21.043062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 12:57:21.210023 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f8f112e3-d4ae-46c6-834b-c255097f6bc4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.685693 Jul 16 12:57:21.210731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 396/807] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 12:57:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 12:57:21.221168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0ac6f1f4-849e-4961-8f61-94a8ec8ed0ae tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:21.221774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0ac6f1f4-849e-4961-8f61-94a8ec8ed0ae tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:21.277171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0ac6f1f4-849e-4961-8f61-94a8ec8ed0ae tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:21.283759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0ac6f1f4-849e-4961-8f61-94a8ec8ed0ae tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1241 microversion: 2.1 time: 0.066956 Jul 16 12:57:21.284386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 412/808] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:21 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:22.302141 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:22.302861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:22.309159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:22.309610 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:22.310383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:22.310828 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:22.373989 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:22.382010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4a9f2671-dc9f-4cdf-afb0-f7cb192a7160 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1237 microversion: 2.1 time: 0.084798 Jul 16 12:57:22.382823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 397/809] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:22 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:23.398926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:23.399531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:23.406641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:23.407084 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:23.407880 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:23.408307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:23.483779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:23.491332 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9bdc8559-e3a9-4c6c-bd61-d11171646e25 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1299 microversion: 2.1 time: 0.096336 Jul 16 12:57:23.491899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 413/810] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:23 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:24.513323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:24.514297 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:24.523416 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:24.524064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:24.524996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:24.525482 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:24.684959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:24.694582 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ebf27f33-53b5-42f1-bddd-5b4535a10021 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.189365 Jul 16 12:57:24.695162 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 398/811] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:24 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:24.840304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-33f35d9c-6ca0-4982-b954-e2f866cf6d0b req-85b0e704-7999-476b-97ea-bb31934ed2bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71378833-c158-4caf-a822-19bc540ecaae", "tag": "eb6e1a8d-0d7a-4d56-887e-3fff249540b1"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:24.851362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-33f35d9c-6ca0-4982-b954-e2f866cf6d0b req-85b0e704-7999-476b-97ea-bb31934ed2bb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:24.851808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-33f35d9c-6ca0-4982-b954-e2f866cf6d0b req-85b0e704-7999-476b-97ea-bb31934ed2bb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:24.864228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-33f35d9c-6ca0-4982-b954-e2f866cf6d0b req-85b0e704-7999-476b-97ea-bb31934ed2bb service nova] Creating event network-changed:eb6e1a8d-0d7a-4d56-887e-3fff249540b1 for instance 71378833-c158-4caf-a822-19bc540ecaae on hv-cinder-83697 Jul 16 12:57:24.872619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-33f35d9c-6ca0-4982-b954-e2f866cf6d0b req-85b0e704-7999-476b-97ea-bb31934ed2bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033376 Jul 16 12:57:24.872619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 414/812] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:25.154732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:25.155223 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:25.161565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:25.162009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:25.162765 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:25.163195 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:25.187679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f9cb8dc9-d72f-469d-9b41-3813e2ee4467 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/ips" status: 200 len: 152 microversion: 2.20 time: 0.036770 Jul 16 12:57:25.188265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 399/813] 10.222.0.47 () {60 vars in 1288 bytes} [Sat Jul 16 12:57:25 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 16 12:57:25.713130 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:25.714028 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:25.720941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:25.721433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:25.723010 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:25.723377 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:25.925619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:25.933454 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3ae82858-3750-401b-b238-6584bc33ac63 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.224838 Jul 16 12:57:25.934020 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 415/814] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:25 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:26.949813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:26.950361 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:26.957083 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:26.957540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:26.958310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:26.958782 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:27.332690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:27.340006 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-802e5f12-3d64-4933-a72c-1264638e9373 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.394216 Jul 16 12:57:27.340568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 400/815] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:26 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:28.357558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:28.358197 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:28.365282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:28.365724 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:28.366471 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:28.366899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:28.407668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:28.408295 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:28.415303 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:28.415868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:28.416689 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:28.417158 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:28.443174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lazy-loading 'flavor' on Instance uuid 5b82d74b-e87f-404e-b369-5bd7955f6318 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:57:28.501103 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:28.509325 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8e3a9a40-ac65-428f-b630-fe5667277d0d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.155548 Jul 16 12:57:28.509927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 416/816] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:28 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:28.972381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ab0ab33b-5dab-4e58-b93a-d7c857371b96 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/action" status: 202 len: 0 microversion: 2.20 time: 0.562544 Jul 16 12:57:28.972381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 401/817] 10.222.0.47 () {62 vars in 1318 bytes} [Sat Jul 16 12:57:28 2022] POST /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 16 12:57:28.975622 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:28.976358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:28.982789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:28.983243 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:28.984008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:28.984449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:29.113773 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:29.121813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:29.123323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:29.124489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b02cfd76-3c68-473e-be86-816bcb337061 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.153282 Jul 16 12:57:29.125030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 417/818] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:28 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:29.528094 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:29.528788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:29.535294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:29.536052 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:29.536747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:29.537208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:29.666524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:29.674010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b715fafc-ad13-4138-bbe1-f0c360ec46e7 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.150691 Jul 16 12:57:29.674572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 402/819] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:29 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:30.142892 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:30.143505 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:30.149925 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:30.150401 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:30.151164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:30.151597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:30.283477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:30.292293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:30.293810 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:30.294948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fcfce339-89a5-41c1-a4f1-b75882669b90 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.156005 Jul 16 12:57:30.295499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 418/820] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:30 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:30.690583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:30.691197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:30.697978 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:30.698428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:30.699188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:30.699628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:30.830011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:30.838851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f1bcd543-1e42-406a-9fd1-1f2a7815971f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.152097 Jul 16 12:57:30.839425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 403/821] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:30 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:31.314129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:31.314756 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:31.317804 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:31.323384 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:31.323848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:31.324627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:31.325087 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:31.454992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:31.463038 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:31.464521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:31.465695 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-da4fe9d0-1ef6-441f-9920-b728e86506cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.155537 Jul 16 12:57:31.470682 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 419/822] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:31 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:31.856026 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:31.856641 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:31.858595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:31.859286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:31.865218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:31.865667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:31.866428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:31.866868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:31.996199 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:32.003532 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c8885557-3926-427e-a12b-ab57d88926b1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.151500 Jul 16 12:57:32.004097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 404/823] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:31 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:32.484483 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:32.485111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:32.491673 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:32.492115 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:32.492910 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:32.493377 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:32.623405 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:32.631751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:32.633274 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:32.634419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-37ec0f12-54f1-4874-868e-fbadf1eec912 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.153902 Jul 16 12:57:32.634972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 420/824] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:32 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:33.019760 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:33.020422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:33.026881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:33.027330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:33.028525 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:33.028525 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:33.072485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-b9cbf1fa-88cd-43ce-9aec-28ee6b36c278 req-1e2eb430-ca1c-4a3a-93fe-cb7ebab80a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71378833-c158-4caf-a822-19bc540ecaae", "name": "network-vif-plugged", "status": "completed", "tag": "eb6e1a8d-0d7a-4d56-887e-3fff249540b1"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:33.078630 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-b9cbf1fa-88cd-43ce-9aec-28ee6b36c278 req-1e2eb430-ca1c-4a3a-93fe-cb7ebab80a75 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:33.079154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-b9cbf1fa-88cd-43ce-9aec-28ee6b36c278 req-1e2eb430-ca1c-4a3a-93fe-cb7ebab80a75 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:33.090185 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-b9cbf1fa-88cd-43ce-9aec-28ee6b36c278 req-1e2eb430-ca1c-4a3a-93fe-cb7ebab80a75 service nova] Creating event network-vif-plugged:eb6e1a8d-0d7a-4d56-887e-3fff249540b1 for instance 71378833-c158-4caf-a822-19bc540ecaae on hv-cinder-83697 Jul 16 12:57:33.095144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-b9cbf1fa-88cd-43ce-9aec-28ee6b36c278 req-1e2eb430-ca1c-4a3a-93fe-cb7ebab80a75 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029668 Jul 16 12:57:33.095740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 421/825] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:57:33.166099 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:33.179263 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a4ab097e-5427-4f23-bda3-153733e067c9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.163285 Jul 16 12:57:33.180194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 405/826] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:33 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:33.653018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:33.653809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:33.660015 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:33.660490 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:33.662988 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:33.662988 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:33.791210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:33.799068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:33.800581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:33.802422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-843252e9-19cb-48ce-837b-4d12c0c5797b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.154082 Jul 16 12:57:33.802978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 422/827] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:33 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:34.199761 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:34.200375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:34.206815 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:34.207268 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:34.208331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:34.208981 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:34.339233 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:34.346469 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2e621d72-379a-480f-9eac-f1d87a81d90f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1366 microversion: 2.1 time: 0.150621 Jul 16 12:57:34.347029 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 406/828] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:34 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:34.821550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:34.822144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:34.828983 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:34.829313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:34.830245 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:34.830419 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:34.969338 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:34.977521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:34.979002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:34.980181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-832b0529-a1bb-480f-87b7-50021692c6f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.163450 Jul 16 12:57:34.980733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 423/829] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:34 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:35.364283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:35.364960 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:35.371416 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:35.371863 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:35.372619 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:35.373071 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:35.501979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:35.509612 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1c5131b2-e684-46d2-8226-762053801a4d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1556 microversion: 2.1 time: 0.149771 Jul 16 12:57:35.510176 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 407/830] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:57:35 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:57:35.525675 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:35.526172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:35.532064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:35.532516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:35.533299 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:35.533736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:35.610865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-61672866-3864-4cc0-8a49-700de0ea9d5f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088957 Jul 16 12:57:35.611453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 424/831] 10.222.0.47 () {58 vars in 1274 bytes} [Sat Jul 16 12:57:35 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:57:35.998123 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:35.998724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:36.005522 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:36.006056 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:36.006847 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:36.007266 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:36.139529 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:36.147659 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:36.149349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:36.150353 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-da69426a-4596-4586-8de5-873919bf7b2c tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.156124 Jul 16 12:57:36.150910 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 408/832] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:35 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:36.595093 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-23faf56c-fd4e-48a8-8a79-7615c1c92eaa req-46294542-815d-4135-bfe4-3aac72d94300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71378833-c158-4caf-a822-19bc540ecaae", "tag": "eb6e1a8d-0d7a-4d56-887e-3fff249540b1"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:36.603307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-23faf56c-fd4e-48a8-8a79-7615c1c92eaa req-46294542-815d-4135-bfe4-3aac72d94300 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:36.603748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-23faf56c-fd4e-48a8-8a79-7615c1c92eaa req-46294542-815d-4135-bfe4-3aac72d94300 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:36.617175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-23faf56c-fd4e-48a8-8a79-7615c1c92eaa req-46294542-815d-4135-bfe4-3aac72d94300 service nova] Creating event network-changed:eb6e1a8d-0d7a-4d56-887e-3fff249540b1 for instance 71378833-c158-4caf-a822-19bc540ecaae on hv-cinder-83697 Jul 16 12:57:36.622010 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-23faf56c-fd4e-48a8-8a79-7615c1c92eaa req-46294542-815d-4135-bfe4-3aac72d94300 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031146 Jul 16 12:57:36.622597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 425/833] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:57:37.172608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:37.172608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:37.176302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:37.176845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:37.177691 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:37.178124 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:37.309732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:37.318617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:37.320137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:37.321369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-16bb2a02-078e-4e76-8060-9d6b410d5731 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.155821 Jul 16 12:57:37.321932 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 409/834] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:37 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:38.340807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:38.341536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:38.347648 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:38.348728 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:38.349564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:38.350002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:38.476591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:38.484455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:38.485991 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:38.487162 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b6181c7a-40e6-4b41-afc4-23ef6ed6e1b0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.151113 Jul 16 12:57:38.487720 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 426/835] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:38 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:39.506198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:39.506804 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:39.513639 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:39.514088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:39.514847 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:39.515286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:39.650383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:39.658360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:39.659865 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:39.661084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0e049373-c9a1-4ae2-aa4d-c1a73c028c6e tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.159342 Jul 16 12:57:39.661655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 410/836] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:39 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:40.680471 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:40.681098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:40.687634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:40.688084 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:40.688869 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:40.689340 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:40.819969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:40.822288 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:40.828582 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:40.832149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:40.832149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-639fdbda-16ba-4da6-a3d8-92c766a1aea2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1744 microversion: 2.20 time: 0.154999 Jul 16 12:57:40.832149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 427/837] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:40 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:41.851145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:41.851755 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:41.858184 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:41.858631 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:41.859393 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:41.859858 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:41.993236 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:41.993236 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:41.998017 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:41.999520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:42.000680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bacdce11-9dd4-46cb-bd55-9f1fb794bbac tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1744 microversion: 2.20 time: 0.154484 Jul 16 12:57:42.001338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 411/838] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:41 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:43.020781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:43.047136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:43.047136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:43.047136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:43.047136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:43.048175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:43.048175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:43.165629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:43.173759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:43.175191 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:43.177457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e67c763f-130c-4a48-b5fd-b0c79e58dc0d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1744 microversion: 2.20 time: 0.160900 Jul 16 12:57:43.178036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 428/839] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:43 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:44.196563 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:44.197204 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:44.199832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:57:44.204765 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:44.205250 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:44.206015 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:44.206458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:44.339069 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:44.346796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:44.348280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:44.349504 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4d2f7fa1-2fdc-4101-b4be-7429d80ff845 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1744 microversion: 2.20 time: 0.157638 Jul 16 12:57:44.350064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 412/840] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:44 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:45.087072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-6261cf7b-1be2-4526-9eb6-b1aadbb4653e req-ed2cd6a1-15f8-41e0-870d-0f2a23292775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "name": "network-vif-plugged", "status": "completed", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:57:45.097495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-6261cf7b-1be2-4526-9eb6-b1aadbb4653e req-ed2cd6a1-15f8-41e0-870d-0f2a23292775 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:45.101412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-6261cf7b-1be2-4526-9eb6-b1aadbb4653e req-ed2cd6a1-15f8-41e0-870d-0f2a23292775 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:45.109006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-6261cf7b-1be2-4526-9eb6-b1aadbb4653e req-ed2cd6a1-15f8-41e0-870d-0f2a23292775 service nova] Creating event network-vif-plugged:8a390625-6257-4d3b-a1a4-2f8ae239dbf9 for instance 5b82d74b-e87f-404e-b369-5bd7955f6318 on hv-cinder-83697 Jul 16 12:57:45.114127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-6261cf7b-1be2-4526-9eb6-b1aadbb4653e req-ed2cd6a1-15f8-41e0-870d-0f2a23292775 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Jul 16 12:57:45.115111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 429/841] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:57:45.367387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:45.368000 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:45.374437 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:45.374883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:45.375640 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:45.376076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:45.505908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:45.513965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:45.515463 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:45.516619 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b64f6493-368e-4c55-a9ca-1ec3d7a6583b tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1744 microversion: 2.20 time: 0.153121 Jul 16 12:57:45.517212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 413/842] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:45 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:46.537148 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:46.537768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:46.545198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:46.548161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:46.548161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:46.548161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:46.678888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:46.685971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:46.687450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:46.688594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e01c614e-3168-42b5-bf17-9f24611fcdbd tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1744 microversion: 2.20 time: 0.156768 Jul 16 12:57:46.689164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 430/843] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:46 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:47.707061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:47.707907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:47.714643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:47.715094 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:47.715870 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:47.716313 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:47.847723 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:47.856277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:47.858474 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:47.858960 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a6aace68-03b0-4dc6-9988-52782e8b5115 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.156100 Jul 16 12:57:47.859512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 414/844] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:47 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:48.877971 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:48.878571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:48.886466 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:48.889531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:48.892087 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:48.893296 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:49.049586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:49.060024 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:49.062597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:49.063836 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b7a42bc4-fcf5-40db-a735-b481c414f5f7 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.190011 Jul 16 12:57:49.064753 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 431/845] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:48 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:50.083021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:50.084574 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:50.091908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:50.092091 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:50.093074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:50.093624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:50.244284 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:50.252683 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:50.254228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:50.255525 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bc8cc79d-93ea-40e4-9cae-8227a34848a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.177486 Jul 16 12:57:50.256272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 415/846] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:50 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:51.274335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:51.274937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:51.281370 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:51.281817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:51.282576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:51.283004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:51.420384 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:51.435289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:51.438005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:51.440130 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fbbb985d-d7ce-4cd9-b985-f1e033dc8a53 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.169373 Jul 16 12:57:51.441125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 432/847] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:51 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:52.460746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:52.462031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:52.469709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:52.470338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:52.471154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:52.471598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:52.633939 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:52.642885 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:52.645616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:52.646845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-41a6b89c-20be-4a37-9efe-ae563d603385 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.190350 Jul 16 12:57:52.658164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 416/848] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:52 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:53.665787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:53.666380 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:53.673146 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:53.673597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:53.674360 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:53.674790 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:53.840954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:53.852003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:53.854672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:53.854932 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4ef04524-d47c-4617-bc76-ea43bf93dc7d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.193208 Jul 16 12:57:53.855730 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 433/849] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:53 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:54.873236 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:54.873788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:54.881979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:54.882457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:54.883217 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:54.883682 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:55.023092 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:55.031842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:55.033378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:55.034558 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c066bd5b-9f52-485d-8f06-7a3c8b3cf2f4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.165352 Jul 16 12:57:55.045911 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 417/850] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:54 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:57:56.053391 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:56.053999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:56.060875 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:56.062141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:56.062141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:56.062650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:56.212317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:56.222906 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:56.225078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:56.226301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5ee8fdec-9b5c-44c7-9877-bc5ad9352ba4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.177448 Jul 16 12:57:56.241066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 434/851] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:56 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:57.249096 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:57.249709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:57.257427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:57.257894 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:57.258664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:57.259101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:57.391141 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:57.403351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:57.403351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:57.403351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ba130485-ada3-4974-9c66-70238a9a4526 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.157090 Jul 16 12:57:57.404689 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 418/852] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:57 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:57:58.420912 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:58.421554 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:58.428683 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:58.429164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:58.430197 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:58.430634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:58.568213 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:58.577153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:58.578700 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:58.579900 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-24716563-7199-4235-87a1-661e78dbae12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1739 microversion: 2.20 time: 0.162889 Jul 16 12:57:58.580507 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 435/853] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:58 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:57:59.598627 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:57:59.599288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:57:59.606350 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:59.606806 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:59.607575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:57:59.608126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:57:59.739651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:59.747694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:59.749244 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:57:59.750406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d6280ba4-578f-4203-b48f-1ec6a9a73525 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1721 microversion: 2.20 time: 0.155808 Jul 16 12:57:59.751242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 419/854] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:57:59 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:00.768868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:00.769484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:00.776046 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:00.776535 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:00.777560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:00.777995 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:00.923383 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:00.932900 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:00.936301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:00.937814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fca21955-33d9-4dcf-a865-da9904debf32 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1721 microversion: 2.20 time: 0.172797 Jul 16 12:58:00.938378 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 436/855] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:00 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:58:01.964136 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:01.964751 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:01.971220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:01.971677 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:01.972447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:01.972919 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:02.107974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:02.116031 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:02.117565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:02.118734 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1603b336-9e1b-4da9-b95d-590cbffc9a5a tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1721 microversion: 2.20 time: 0.158534 Jul 16 12:58:02.119307 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 420/856] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:01 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:03.138194 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:03.138831 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:03.145251 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:03.145701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:03.146461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:03.146894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:03.178037 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-b3ecdd10-ee4d-4c3f-833b-cc23f1d52e4f req-ca89dd3f-4810-4d8d-9bb3-8447f0422285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "name": "network-vif-unplugged", "status": "completed", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:03.188360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-b3ecdd10-ee4d-4c3f-833b-cc23f1d52e4f req-ca89dd3f-4810-4d8d-9bb3-8447f0422285 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:03.188869 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-b3ecdd10-ee4d-4c3f-833b-cc23f1d52e4f req-ca89dd3f-4810-4d8d-9bb3-8447f0422285 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:03.201499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.compute.server_external_events [req-b3ecdd10-ee4d-4c3f-833b-cc23f1d52e4f req-ca89dd3f-4810-4d8d-9bb3-8447f0422285 service nova] Unable to find a host for instance 5b82d74b-e87f-404e-b369-5bd7955f6318. Dropping event network-vif-unplugged {{(pid=124652) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 16 12:58:03.202382 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-b3ecdd10-ee4d-4c3f-833b-cc23f1d52e4f req-ca89dd3f-4810-4d8d-9bb3-8447f0422285 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028176 Jul 16 12:58:03.202999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 421/857] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 16 12:58:03.282067 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:03.290072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:03.291578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:03.292734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-584f8aab-d5ce-4ed4-bed6-5ecffc7cf2d2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1664 microversion: 2.20 time: 0.159149 Jul 16 12:58:03.293412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 437/858] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:03 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:03.310658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b211590-b437-42d0-9f94-ed0017fe61d3"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:03.311721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:03.317764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:03.318214 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:03.318979 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:03.319412 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:04.335495 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6440cb02-7c58-49f8-8fa3-976a8b0b0ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.029036 Jul 16 12:58:04.336133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 422/859] 10.222.0.47 () {62 vars in 1363 bytes} [Sat Jul 16 12:58:03 2022] POST /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-volume_attachments => generated 188 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 16 12:58:04.450399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:04.450894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:04.459335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:04.459775 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:04.460523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:04.460949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:05.069271 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c7ff46ec-3719-4f57-92a7-5b24aab64398 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-volume_attachments/5b211590-b437-42d0-9f94-ed0017fe61d3" status: 202 len: 0 microversion: 2.20 time: 0.623490 Jul 16 12:58:05.069789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 438/860] 10.222.0.47 () {60 vars in 1456 bytes} [Sat Jul 16 12:58:04 2022] DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-volume_attachments/5b211590-b437-42d0-9f94-ed0017fe61d3 => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:58:05.125350 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:05.125923 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:05.132148 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:05.132624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:05.133434 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:05.133871 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:05.334757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d70cf3c0-6639-470b-9a93-d98730f91e24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "POST /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/action" status: 202 len: 0 microversion: 2.20 time: 0.213008 Jul 16 12:58:05.335285 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 423/861] 10.222.0.47 () {62 vars in 1318 bytes} [Sat Jul 16 12:58:05 2022] POST /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:58:05.344216 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:05.345088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:05.351514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:05.351959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:05.352709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:05.353164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:05.482276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:05.490258 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:05.491692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:05.492845 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3ad9dca0-8a05-4440-8ace-6a2e88c7f475 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1672 microversion: 2.20 time: 0.153352 Jul 16 12:58:05.493421 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 439/862] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:05 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:06.510776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:06.512101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:06.518664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:06.519116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:06.519914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:06.520349 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:06.650272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:06.658330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:06.660077 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:06.661280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-396c6a5b-4304-42e3-abc2-3cc0337e945f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1674 microversion: 2.20 time: 0.154387 Jul 16 12:58:06.661845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 424/863] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:06 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:07.682225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:07.682806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:07.689487 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:07.689928 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:07.690687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:07.691113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:07.901707 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:07.910247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:07.911740 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:07.912890 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cf5949b3-afab-40b6-a986-a15b8336b432 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.234846 Jul 16 12:58:07.913476 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 440/864] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:07 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:08.931784 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:08.932389 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:08.939286 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:08.939731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:08.940495 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:08.940928 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:08.956915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:09.086606 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:09.096182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:09.097746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:09.098915 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-628678b3-399b-4d50-b9b4-406d2a82d6a4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.171394 Jul 16 12:58:09.100405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 425/865] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:08 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:10.117413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:10.118020 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:10.126042 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:10.126482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:10.127244 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:10.127668 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:10.279788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:10.288040 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:10.289607 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:10.290802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3847953f-185d-4e54-8e9c-b9542e5091da tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.177384 Jul 16 12:58:10.291359 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 441/866] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:10 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:11.310958 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:11.311535 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:11.318440 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:11.318894 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:11.319672 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:11.320117 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:11.454939 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:11.462961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:11.464458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:11.465816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-16cf570d-58d5-4e20-a106-24eb4d9f4098 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.159846 Jul 16 12:58:11.466677 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 426/867] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:11 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:12.485400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:12.486036 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:12.492636 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:12.493202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:12.494035 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:12.494716 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:12.514239 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:12.633717 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:12.642445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:12.643994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:12.645249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2f62f5a8-aff2-494e-8926-248c4b7ef9a0 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.163780 Jul 16 12:58:12.646033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 442/868] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:12 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:13.662999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:13.664088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:13.673228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:13.673766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:13.674643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:13.675162 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:13.853987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:13.863370 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:13.865167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:13.866525 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-72c55fc2-8c13-4ec5-9a4e-64a868b9f505 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.207345 Jul 16 12:58:13.867084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 427/869] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:13 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:14.885477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:14.886094 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:14.893640 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:14.894094 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:14.894857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:14.895294 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:15.040034 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:15.048368 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:15.049878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:15.051061 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-79fe0ed7-21c9-4cd0-a575-dd9d6318d2ff tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.169919 Jul 16 12:58:15.058450 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 443/870] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:14 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:16.069706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:16.070345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:16.073816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=34 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:16.078124 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:16.078857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:16.079340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:16.079792 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:16.099374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:16.099925 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:16.107477 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:16.108090 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:16.108857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:16.109316 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:16.135556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4b0b8ea2-f40a-48f9-b185-dcc8ca1ddf12 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/ips" status: 200 len: 145 microversion: 2.1 time: 0.040086 Jul 16 12:58:16.141197 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 444/871] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:58:16 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:58:16.243980 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:16.257084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:16.265586 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:16.267028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2a6f768e-4dd4-4083-87e3-ffeeb063d429 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.201198 Jul 16 12:58:16.279330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 428/872] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:16 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:17.287151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:17.287867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:17.290186 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=34 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:17.295055 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:17.295506 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:17.296276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:17.296711 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:17.437357 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:17.445495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:17.446999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:17.448214 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-55d1a8a5-db10-418a-859f-7cedca612004 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.165076 Jul 16 12:58:17.448779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 445/873] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:17 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:18.466899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:18.467504 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:18.474085 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:18.474533 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:18.475281 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:18.475712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:18.602703 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:18.610873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:18.612360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:18.613562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-427b204e-3bd4-47b6-a996-b543a1acfbc4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.150755 Jul 16 12:58:18.614100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 429/874] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:18 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:18.847355 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e727ac6e-6a54-418b-9512-7d6800386686"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:18.848480 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:18.855994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:18.856443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:18.857311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:18.857748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:19.631588 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:19.632199 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:19.639220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:19.639670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:19.640707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:19.641169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:19.790482 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:19.798462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:19.799965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:19.801161 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-72ada483-22c1-4c14-89de-be4c5283a4d9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.173551 Jul 16 12:58:19.801719 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 430/875] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:19 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:58:20.819927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:20.820584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:20.827087 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:20.827533 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:20.828293 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:20.828733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:20.958425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:20.967561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:20.969088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:20.970252 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-602388cc-38c5-4b38-8306-863c96ad3204 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.154298 Jul 16 12:58:20.970814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 431/876] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:20 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:58:21.988891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:21.989585 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:21.995982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:21.996437 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:21.997232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:21.997671 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:22.129906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:22.138538 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:22.140033 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:22.141228 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bdc43219-7ff0-4b9c-aa9e-ff11a2996b12 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.156221 Jul 16 12:58:22.141785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 432/877] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:21 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:58:23.159842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:23.160524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:23.166800 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:23.167250 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:23.169119 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:23.169570 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:23.298997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:23.307079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:23.308562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:23.309907 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2de99ce0-4e76-4e0c-836c-cabe0c14f42f tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.153981 Jul 16 12:58:23.310461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 433/878] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:23 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 16 12:58:24.061470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e9cbdc04-ec4c-4c75-96a4-38be877f3bae tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.217819 Jul 16 12:58:24.062231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 446/879] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:58:18 2022] POST /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments => generated 194 bytes in 5219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:24.327655 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:24.328254 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:24.334951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:24.335398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:24.336152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:24.336583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:24.470308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:24.478138 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:24.479630 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:24.481411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f7cd5b01-f720-489f-b1f0-9471bf1a7bde tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.157063 Jul 16 12:58:24.481970 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 434/880] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:24 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:25.501306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:25.502002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:25.508852 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:25.509324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:25.510083 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:25.510517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:25.640193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:25.648117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:25.649651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:25.650794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4415c92c-9ea2-4b1c-b24f-53261760838d tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.154875 Jul 16 12:58:25.651346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 447/881] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:25 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:26.669688 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:26.670357 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:26.676394 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:26.676840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:26.677625 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:26.678057 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:26.805818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:26.814637 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:26.816120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:26.817302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6b8e5d9c-7a4f-49d3-8b99-370cc1644864 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.151950 Jul 16 12:58:26.817864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 435/882] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:26 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:27.417391 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-b85a4ff6-780a-4a4a-8fcc-0e666c26b6f7 req-205d60c6-b2bb-4d56-9d84-5a2e41c07ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "name": "network-vif-plugged", "status": "completed", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:27.426662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-b85a4ff6-780a-4a4a-8fcc-0e666c26b6f7 req-205d60c6-b2bb-4d56-9d84-5a2e41c07ab1 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:27.427098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-b85a4ff6-780a-4a4a-8fcc-0e666c26b6f7 req-205d60c6-b2bb-4d56-9d84-5a2e41c07ab1 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:27.438529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-b85a4ff6-780a-4a4a-8fcc-0e666c26b6f7 req-205d60c6-b2bb-4d56-9d84-5a2e41c07ab1 service nova] Creating event network-vif-plugged:8a390625-6257-4d3b-a1a4-2f8ae239dbf9 for instance 5b82d74b-e87f-404e-b369-5bd7955f6318 on hv-cinder-83697 Jul 16 12:58:27.443629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-b85a4ff6-780a-4a4a-8fcc-0e666c26b6f7 req-205d60c6-b2bb-4d56-9d84-5a2e41c07ab1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029851 Jul 16 12:58:27.444217 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 448/883] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:27.835797 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:27.836411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:27.843387 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:27.843844 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:27.844611 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:27.845074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:27.974869 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:27.982891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:27.984381 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:27.985561 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b261a128-99ac-4d5c-a37c-146473f5dffb tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.153803 Jul 16 12:58:27.986145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 436/884] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:27 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:29.003946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:29.004739 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:29.011247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:29.011689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:29.012725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:29.013192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:29.142023 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:29.150108 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:29.151649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:29.153473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9c96cec8-1220-4d99-8aa6-0a8a3a0ad5cc tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.153080 Jul 16 12:58:29.154031 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 449/885] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:28 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:30.172666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:30.173419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:30.180214 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:30.180656 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:30.181451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:30.181882 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:30.316048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:30.324028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:30.325726 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:30.326905 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f1864721-ec80-411c-8b1c-50b8d385c123 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1730 microversion: 2.20 time: 0.159103 Jul 16 12:58:30.327462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 437/886] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:30 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:31.345324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:31.345859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:31.353132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:31.353576 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:31.354332 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:31.354759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:31.488212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:31.496386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:31.497939 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:31.499081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9d1aee2c-982e-4457-8f84-598fb2d47198 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1717 microversion: 2.20 time: 0.157994 Jul 16 12:58:31.499624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 450/887] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:58:31 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:58:31.545209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:31.546198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:31.552712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:31.553322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:31.554089 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:31.554524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:31.584822 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-826846e3-c80c-4e7f-ac8a-6104ad581481 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Jul 16 12:58:31.585498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 438/888] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:58:31 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:31.596026 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:31.596453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:31.602609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:31.603057 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:31.603817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:31.604250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:31.631991 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3085b84e-e405-4728-9a05-22f125ecd3a4 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/e727ac6e-6a54-418b-9512-7d6800386686" status: 200 len: 194 microversion: 2.1 time: 0.039972 Jul 16 12:58:31.632555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 451/889] 10.222.0.47 () {58 vars in 1412 bytes} [Sat Jul 16 12:58:31 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/e727ac6e-6a54-418b-9512-7d6800386686 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:33.226827 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c87014a-3810-4b35-8a0b-4ee845a79b0b"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:33.227924 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:33.235232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:33.235676 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:33.236425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:33.236858 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:33.957291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b30ae0ec-2291-4bf2-ae50-d5fbf8171332 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "POST /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734159 Jul 16 12:58:33.958126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 439/890] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:58:33 2022] POST /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:42.486018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:42.486949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:42.489525 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=13 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:42.490188 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:42.494972 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:42.502572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:42.502572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:42.502572 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:42.527493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6e6b4b3c-1450-481f-aed7-721b43182eda tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046166 Jul 16 12:58:42.528567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 452/891] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:58:42 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:42.671997 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:42.672595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:42.678961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:42.679406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:42.680421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:42.680853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:42.685231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:42.710334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-22f21536-fc10-4a6d-9ec0-c286f17cc4a5 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/e727ac6e-6a54-418b-9512-7d6800386686" status: 200 len: 194 microversion: 2.1 time: 0.043459 Jul 16 12:58:42.710908 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 440/892] 10.222.0.47 () {58 vars in 1412 bytes} [Sat Jul 16 12:58:42 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/e727ac6e-6a54-418b-9512-7d6800386686 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:42.720522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:42.721011 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:42.728201 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:42.731797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:42.731797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:42.731797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:42.810334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lazy-loading 'services' on Instance uuid fb2122a2-18d0-4d75-a803-f0c59b035e7b {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:58:42.998286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5616b24c-2ed9-4b04-aac7-e7747c93bf93 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/e727ac6e-6a54-418b-9512-7d6800386686" status: 202 len: 0 microversion: 2.1 time: 0.281357 Jul 16 12:58:42.998804 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 453/893] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:58:42 2022] DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/e727ac6e-6a54-418b-9512-7d6800386686 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:58:45.158753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:45.159269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:45.166010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:45.166458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:45.167217 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:45.167650 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:45.198056 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-98088ff8-3958-43eb-a7ff-895b20902088 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/7c87014a-3810-4b35-8a0b-4ee845a79b0b" status: 200 len: 194 microversion: 2.1 time: 0.043711 Jul 16 12:58:45.198641 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 441/894] 10.222.0.47 () {58 vars in 1412 bytes} [Sat Jul 16 12:58:45 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/7c87014a-3810-4b35-8a0b-4ee845a79b0b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:45.210456 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:45.211025 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:45.218235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:45.218586 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:45.219347 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:45.219776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:45.307627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lazy-loading 'services' on Instance uuid fb2122a2-18d0-4d75-a803-f0c59b035e7b {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:58:45.506630 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c693cfd0-05b7-4d56-a28c-46aa6cce3d84 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/7c87014a-3810-4b35-8a0b-4ee845a79b0b" status: 202 len: 0 microversion: 2.1 time: 0.301148 Jul 16 12:58:45.507207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 454/895] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:58:45 2022] DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments/7c87014a-3810-4b35-8a0b-4ee845a79b0b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:58:46.668259 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:46.669229 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:46.672238 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=28 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:58:46.677385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:46.677828 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:46.678580 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:46.679088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:46.711103 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2e3a59d6-5c49-41ab-8b04-ef1e7e420fdb tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047107 Jul 16 12:58:46.711581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 442/896] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:58:46 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:58:46.816602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:46.817788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:46.823922 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:46.824368 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:46.825149 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:46.825581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:46.853629 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-758f69f7-dc54-4abe-99f0-0328736c208e tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042715 Jul 16 12:58:46.854175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 455/897] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:58:46 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:58:46.909972 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:46.910470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:46.917025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:46.917508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:46.918272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:46.918708 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:46.943543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:58:47.252795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-afb9d07d-5c10-440b-87d7-79cd775d442f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 204 len: 0 microversion: 2.1 time: 0.346560 Jul 16 12:58:47.253439 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 443/898] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:58:46 2022] DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:58:47.262234 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:47.264594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:47.269855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:47.270286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:47.271160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:47.271591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:47.401591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:47.409501 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c3729afc-4d44-4c47-9cc6-37dcc93983b0 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1674 microversion: 2.1 time: 0.151592 Jul 16 12:58:47.410068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 456/899] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:47 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:58:48.427886 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:48.428596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:48.435425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:48.435873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:48.436842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:48.437322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:48.564364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:48.571878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9423673b-ed6e-47f4-8e95-2682473a190a tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1674 microversion: 2.1 time: 0.148253 Jul 16 12:58:48.572442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 444/900] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:48 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:58:49.589003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:49.589774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:49.597445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:49.597898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:49.598687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:49.599103 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:49.824054 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:49.832214 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-86ad4e69-bd3a-46e2-b0f4-73e54cdd7112 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1674 microversion: 2.1 time: 0.247196 Jul 16 12:58:49.832788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 457/901] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:49 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1674 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:58:50.432438 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-217f4cc4-d884-4085-b2c0-94e6a069ecda req-64997b7d-8bed-4b2d-b53f-4123c9a9619f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb2122a2-18d0-4d75-a803-f0c59b035e7b", "name": "network-vif-deleted", "tag": "c21200de-2f15-4e22-b9dc-a6e7ef0bd20d"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:58:50.443442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-217f4cc4-d884-4085-b2c0-94e6a069ecda req-64997b7d-8bed-4b2d-b53f-4123c9a9619f service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:50.443897 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-217f4cc4-d884-4085-b2c0-94e6a069ecda req-64997b7d-8bed-4b2d-b53f-4123c9a9619f service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:50.456212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-217f4cc4-d884-4085-b2c0-94e6a069ecda req-64997b7d-8bed-4b2d-b53f-4123c9a9619f service nova] Creating event network-vif-deleted:c21200de-2f15-4e22-b9dc-a6e7ef0bd20d for instance fb2122a2-18d0-4d75-a803-f0c59b035e7b on hv-cinder-83697 Jul 16 12:58:50.461086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-217f4cc4-d884-4085-b2c0-94e6a069ecda req-64997b7d-8bed-4b2d-b53f-4123c9a9619f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032468 Jul 16 12:58:50.463738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 445/902] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:58:50.849615 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:50.850304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:50.856893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:50.857539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:50.858966 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:50.859512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:50.890489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:50.890854 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:50.891308 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lazy-loading 'fault' on Instance uuid fb2122a2-18d0-4d75-a803-f0c59b035e7b {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:58:50.937302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46b5c80d8bf34965a30b9b67e9117996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858d6855277f465497c27313765e5d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:58:50.944914 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6191cc17-bead-441a-8f62-255a4fff1fbe tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 200 len: 1328 microversion: 2.1 time: 0.099755 Jul 16 12:58:50.945559 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 458/903] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:50 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:58:51.970464 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:51.971162 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:51.978126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:51.978575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:51.979342 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:51.979778 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:51.992648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] HTTP exception thrown: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Request method failure captured: Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b HTTP/1.1 Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO_f6ehHzpmBZSBrYY1MJXhKDhrQf3w8ibGZ2GOcNsdI71Xw0m8jRfqvFK5LW4j28SNCKCJqi6fkmdf10vlzPYw0u5QFpuGWbZXrBP1Kck6sIw6pUA_UIF45t_r_dsaFUOf1yK1GxK2IRQHO6DnrEeU9L2MwMyFhsoDhWrHTqSlfsY Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:58:51.994323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_858d6855277f465497c27313765e5d1a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/858d6855277f465497c27313765e5d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 46b5c80d8bf34965a30b9b67e9117996 Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:51.995920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'fb2122a2-18d0-4d75-a803-f0c59b035e7b'} Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:58:51.996917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:51.999003 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:52.000654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Returning 404 to user: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:58:52.000654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c0db2986-5489-410a-b805-4216bfef4ef3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 404 len: 111 microversion: 2.1 time: 0.030238 Jul 16 12:58:52.000654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 446/904] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:51 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:58:52.004422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-602253c6-59e9-4f4d-8a8b-77a115c1d0b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '.version_select at 0x7f6cf8c801f0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:52.082558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-602253c6-59e9-4f4d-8a8b-77a115c1d0b3 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017371057" status: 202 len: 0 microversion: 2.1 time: 0.081759 Jul 16 12:58:52.083129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 459/905] 10.222.0.47 () {58 vars in 1220 bytes} [Sat Jul 16 12:58:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017371057 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:58:55.346722 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:55.347230 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:55.353704 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:55.354155 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:55.354918 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:55.355355 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:55.369098 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] HTTP exception thrown: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Request method failure captured: Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b HTTP/1.1 Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO_f6ehHzpmBZSBrYY1MJXhKDhrQf3w8ibGZ2GOcNsdI71Xw0m8jRfqvFK5LW4j28SNCKCJqi6fkmdf10vlzPYw0u5QFpuGWbZXrBP1Kck6sIw6pUA_UIF45t_r_dsaFUOf1yK1GxK2IRQHO6DnrEeU9L2MwMyFhsoDhWrHTqSlfsY Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:58:55.370628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_858d6855277f465497c27313765e5d1a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/858d6855277f465497c27313765e5d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 46b5c80d8bf34965a30b9b67e9117996 Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.372197 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'fb2122a2-18d0-4d75-a803-f0c59b035e7b'} Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:58:55.373108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.374937 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.376407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Returning 404 to user: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:58:55.376407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-da741acb-06b8-4078-8e05-3c3adad07d7f tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 404 len: 111 microversion: 2.1 time: 0.029206 Jul 16 12:58:55.376407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 447/906] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:58:55 2022] DELETE /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:58:55.381445 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:55.382054 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: fb2122a2-18d0-4d75-a803-f0c59b035e7b] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:55.389413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:55.389892 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:55.390648 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:55.391079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:55.406163 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] HTTP exception thrown: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Request method failure captured: Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b HTTP/1.1 Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO_f6ehHzpmBZSBrYY1MJXhKDhrQf3w8ibGZ2GOcNsdI71Xw0m8jRfqvFK5LW4j28SNCKCJqi6fkmdf10vlzPYw0u5QFpuGWbZXrBP1Kck6sIw6pUA_UIF45t_r_dsaFUOf1yK1GxK2IRQHO6DnrEeU9L2MwMyFhsoDhWrHTqSlfsY Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:58:55.407784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_858d6855277f465497c27313765e5d1a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/858d6855277f465497c27313765e5d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 46b5c80d8bf34965a30b9b67e9117996 Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.410269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'fb2122a2-18d0-4d75-a803-f0c59b035e7b'} Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:58:55.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. Jul 16 12:58:55.414548 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:55.416867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Returning 404 to user: Instance fb2122a2-18d0-4d75-a803-f0c59b035e7b could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:58:55.416867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ae9a1a1c-65a7-4308-9b44-97dfa525d7c6 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b" status: 404 len: 111 microversion: 2.1 time: 0.031818 Jul 16 12:58:55.416867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 460/907] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:55 2022] GET /compute/v2.1/servers/fb2122a2-18d0-4d75-a803-f0c59b035e7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:58:56.642123 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:56.642621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:56.649017 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:56.649494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:56.650248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:56.650681 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:56.664642 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] HTTP exception thrown: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Request method failure captured: Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 HTTP/1.1 Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO_f6ehHzpmBZSBrYY1MJXhKDhrQf3w8ibGZ2GOcNsdI71Xw0m8jRfqvFK5LW4j28SNCKCJqi6fkmdf10vlzPYw0u5QFpuGWbZXrBP1Kck6sIw6pUA_UIF45t_r_dsaFUOf1yK1GxK2IRQHO6DnrEeU9L2MwMyFhsoDhWrHTqSlfsY Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:58:56.666282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_858d6855277f465497c27313765e5d1a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/858d6855277f465497c27313765e5d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 46b5c80d8bf34965a30b9b67e9117996 Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.667825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'b56c8229-cd52-4255-9f93-6025d9859b44'} Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:58:56.668721 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.671171 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.672604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Returning 404 to user: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:58:56.672604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-08274c01-5ed8-4b9f-a301-d55298bda2f8 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 404 len: 111 microversion: 2.1 time: 0.029478 Jul 16 12:58:56.672604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 448/908] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:58:56 2022] DELETE /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:58:56.676417 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:58:56.677023 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] [instance: b56c8229-cd52-4255-9f93-6025d9859b44] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:58:56.683225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:56.683667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:56.684411 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:58:56.684838 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:58:56.697596 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] HTTP exception thrown: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Request method failure captured: Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 HTTP/1.1 Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO_f6ehHzpmBZSBrYY1MJXhKDhrQf3w8ibGZ2GOcNsdI71Xw0m8jRfqvFK5LW4j28SNCKCJqi6fkmdf10vlzPYw0u5QFpuGWbZXrBP1Kck6sIw6pUA_UIF45t_r_dsaFUOf1yK1GxK2IRQHO6DnrEeU9L2MwMyFhsoDhWrHTqSlfsY Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:58:56.699079 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_858d6855277f465497c27313765e5d1a", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/858d6855277f465497c27313765e5d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/858d6855277f465497c27313765e5d1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 858d6855277f465497c27313765e5d1a Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959008130 Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 46b5c80d8bf34965a30b9b67e9117996 Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeTestJSON-1959008130-project Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.700580 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'b56c8229-cd52-4255-9f93-6025d9859b44'} Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:58:56.701493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. Jul 16 12:58:56.703039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:58:56.704371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] Returning 404 to user: Instance b56c8229-cd52-4255-9f93-6025d9859b44 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:58:56.704371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d7658d6c-baee-46c8-b72e-eaa15d332289 tempest-AttachVolumeTestJSON-1959008130 tempest-AttachVolumeTestJSON-1959008130-project] 10.222.0.47 "GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44" status: 404 len: 111 microversion: 2.1 time: 0.027735 Jul 16 12:58:56.704371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 461/909] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:58:56 2022] GET /compute/v2.1/servers/b56c8229-cd52-4255-9f93-6025d9859b44 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:02.103524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-e27390b9-c979-4a88-ac09-cbe5d92e1492 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Action: 'create', calling method: .version_select at 0x7f6cf8ee4040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1497962192"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:02.875371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-e27390b9-c979-4a88-ac09-cbe5d92e1492 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.903276 Jul 16 12:59:02.875990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 449/910] 10.222.0.47 () {60 vars in 1154 bytes} [Sat Jul 16 12:59:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 905 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 16 12:59:02.886816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-46bd2598-cf3c-4418-9e25-b9450378be82 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c67820>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:02.988362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-46bd2598-cf3c-4418-9e25-b9450378be82 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 200 len: 345 microversion: 2.1 time: 0.105432 Jul 16 12:59:02.988924 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 462/911] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:02 2022] GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:02.994338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:02.994861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:03.001977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:03.002426 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:03.003188 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:03.003623 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:03.026459 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1de30958-6e04-4f35-a698-4e8964b9f4eb tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/ips" status: 200 len: 150 microversion: 2.1 time: 0.036672 Jul 16 12:59:03.027024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 450/912] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:59:02 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:04.001304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a08871a3-1aaa-433f-947c-b31e31d8cb1d tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c113a0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:04.049428 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a08871a3-1aaa-433f-947c-b31e31d8cb1d tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 200 len: 346 microversion: 2.1 time: 0.052388 Jul 16 12:59:04.050063 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 463/913] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:03 2022] GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:04.062009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d3388dab-851f-4837-8486-1afc8aeaa4b7 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Action: 'create', calling method: .version_select at 0x7f6cf8cc9c10>, body: {"snapshot": {"volume_id": "7088ac79-10c4-4e05-9011-c12fc68f5fa8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-450561020"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:04.539888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d3388dab-851f-4837-8486-1afc8aeaa4b7 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.482448 Jul 16 12:59:04.540477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 451/914] 10.222.0.47 () {60 vars in 1161 bytes} [Sat Jul 16 12:59:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:04.551085 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8b13b7a6-ddf7-47ed-9b7d-69cc71ff60e5 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c1fa60>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:04.583315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8b13b7a6-ddf7-47ed-9b7d-69cc71ff60e5 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.036079 Jul 16 12:59:04.591269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 464/915] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:04 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:04.593985 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-97f506de-493d-4d3d-9712-2db360390792 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8bb5040>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:04.616978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0016f47c-f24c-4be8-ae5d-91c214d6140b"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:04.619974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:04.624895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-97f506de-493d-4d3d-9712-2db360390792 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034850 Jul 16 12:59:04.625049 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:04.625390 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:04.625807 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 452/916] 10.222.0.47 () {58 vars in 1139 bytes} [Sat Jul 16 12:59:04 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:04.626158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:04.626596 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:04.635237 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-48ca779a-b5f0-4aa3-b5ad-31af31cf1e54 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8d04d30>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:04.666234 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-48ca779a-b5f0-4aa3-b5ad-31af31cf1e54 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.034562 Jul 16 12:59:04.666810 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 453/917] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:04 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:59:05.323157 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-dd86a791-30ee-491c-853b-c623a5ae66d1 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "POST /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.709856 Jul 16 12:59:05.323690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 465/918] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 12:59:04 2022] POST /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:05.680007 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d330bbdb-c176-415e-a199-d2156ddc12e2 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8bb5700>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:05.709057 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d330bbdb-c176-415e-a199-d2156ddc12e2 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.034062 Jul 16 12:59:05.709630 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 454/919] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:05 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:06.722380 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-06b669ff-197f-42e6-8eba-0c3af5d0e3c3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c67af0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:06.752564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-06b669ff-197f-42e6-8eba-0c3af5d0e3c3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.034378 Jul 16 12:59:06.753171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 466/920] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:06 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:07.765060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-37bd6c4a-9a89-417e-863b-1ab470d1dafa tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8bb3ca0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:07.793701 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-37bd6c4a-9a89-417e-863b-1ab470d1dafa tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.033394 Jul 16 12:59:07.794365 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 455/921] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:07 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:08.806672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7911ba60-c1b3-4c91-b9ff-c5ab23e494d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c80040>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:08.835161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7911ba60-c1b3-4c91-b9ff-c5ab23e494d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.033085 Jul 16 12:59:08.835723 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 467/922] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:08 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:09.186697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 12:59:09.186875 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 12:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 12:59:09.847453 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bc321377-059b-41e6-b0de-2e252c09cdac tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8eec430>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:09.879842 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bc321377-059b-41e6-b0de-2e252c09cdac tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 287 microversion: 2.1 time: 0.036926 Jul 16 12:59:09.880405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 456/923] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:09 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:09.891324 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2ed8a27b-83a1-47d6-abc4-ab40c3784eaf tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8cd1820>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:09.995894 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2ed8a27b-83a1-47d6-abc4-ab40c3784eaf tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 202 len: 0 microversion: 2.1 time: 0.109362 Jul 16 12:59:09.996458 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 468/924] 10.222.0.47 () {58 vars in 1253 bytes} [Sat Jul 16 12:59:09 2022] DELETE /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:59:10.005584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-99e33495-466c-4325-9b46-c1ecd39d375e tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8ee4ca0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:10.034143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-99e33495-466c-4325-9b46-c1ecd39d375e tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 200 len: 286 microversion: 2.1 time: 0.032324 Jul 16 12:59:10.038218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 457/925] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:10 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:11.048402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a13bdf58-f055-4dfc-add7-ae68ee45b447 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c67af0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:11.073533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-a13bdf58-f055-4dfc-add7-ae68ee45b447 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] HTTP exception thrown: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a13bdf58-f055-4dfc-add7-ae68ee45b447 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Request method failure captured: Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b HTTP/1.1 Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rYV7wrPfgIAoD0SWADW3U3gsGjB3YnIruHX0cuyFEZE5XPkdK2IFC6YAXgKyEsJsjhEUS6EiyTfs2jLuaebhs2qBoqtcv9ugOjTID2-QRHonpv5epgjr47FV_Py6jQQoh9Iyil1KH5ALhrs3YnTd0rqQ0CTR3nBDiCi6-HRnNH-3PE Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:11.077799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_185422595a1e4037afa71e49c8837f96", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/185422595a1e4037afa71e49c8837f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: ec4bec9d38704e4b92ad06336f3a7a3c Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '50d57750-2b3c-4fa5-96ad-722f608d573b'} Jul 16 12:59:11.079266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. (HTTP 404) (Request-ID: req-1b1be472-fe3f-4e58-b925-630889c0a3ff) Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.080098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:11.081521 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 16 12:59:11.083006 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a13bdf58-f055-4dfc-add7-ae68ee45b447 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Returning 404 to user: Snapshot 50d57750-2b3c-4fa5-96ad-722f608d573b could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a13bdf58-f055-4dfc-add7-ae68ee45b447 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b" status: 404 len: 111 microversion: 2.1 time: 0.035427 Jul 16 12:59:11.084522 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 469/926] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 12:59:11 2022] GET /compute/v2.1/os-snapshots/50d57750-2b3c-4fa5-96ad-722f608d573b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:11.088556 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-fb85420f-9e2a-4134-94c5-c0540d19efda tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8e8b550>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:11.309358 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-fb85420f-9e2a-4134-94c5-c0540d19efda tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 202 len: 0 microversion: 2.1 time: 0.225194 Jul 16 12:59:11.309935 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 458/927] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:59:11 2022] DELETE /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:59:11.319246 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d80c84e4-f82b-46ea-8e77-415be33a4fdb tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8caa820>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:11.365879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d80c84e4-f82b-46ea-8e77-415be33a4fdb tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 200 len: 345 microversion: 2.1 time: 0.050609 Jul 16 12:59:11.366417 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 470/928] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:11 2022] GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:12.379410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f4ce6142-ca26-4151-b9cc-a66c787877d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8beadc0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:12.407124 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-f4ce6142-ca26-4151-b9cc-a66c787877d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] HTTP exception thrown: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f4ce6142-ca26-4151-b9cc-a66c787877d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Request method failure captured: Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 HTTP/1.1 Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rYV7wrPfgIAoD0SWADW3U3gsGjB3YnIruHX0cuyFEZE5XPkdK2IFC6YAXgKyEsJsjhEUS6EiyTfs2jLuaebhs2qBoqtcv9ugOjTID2-QRHonpv5epgjr47FV_Py6jQQoh9Iyil1KH5ALhrs3YnTd0rqQ0CTR3nBDiCi6-HRnNH-3PE Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:12.410321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_185422595a1e4037afa71e49c8837f96", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/185422595a1e4037afa71e49c8837f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: ec4bec9d38704e4b92ad06336f3a7a3c Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '7088ac79-10c4-4e05-9011-c12fc68f5fa8'} Jul 16 12:59:12.411839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. (HTTP 404) (Request-ID: req-bfe0e4ab-7af8-4727-8b1c-188ffc4be626) Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.412667 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:12.413879 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 16 12:59:12.415034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f4ce6142-ca26-4151-b9cc-a66c787877d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Returning 404 to user: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f4ce6142-ca26-4151-b9cc-a66c787877d3 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 404 len: 109 microversion: 2.1 time: 0.037142 Jul 16 12:59:12.416569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 459/929] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:12 2022] GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:12.422484 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1bab4049-34c0-4d77-b48d-480636ba2601 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8c113a0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:12.450710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-1bab4049-34c0-4d77-b48d-480636ba2601 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] HTTP exception thrown: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1bab4049-34c0-4d77-b48d-480636ba2601 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Request method failure captured: Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: DELETE /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 HTTP/1.1 Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rYV7wrPfgIAoD0SWADW3U3gsGjB3YnIruHX0cuyFEZE5XPkdK2IFC6YAXgKyEsJsjhEUS6EiyTfs2jLuaebhs2qBoqtcv9ugOjTID2-QRHonpv5epgjr47FV_Py6jQQoh9Iyil1KH5ALhrs3YnTd0rqQ0CTR3nBDiCi6-HRnNH-3PE Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:12.452957 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_185422595a1e4037afa71e49c8837f96", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/185422595a1e4037afa71e49c8837f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: ec4bec9d38704e4b92ad06336f3a7a3c Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '7088ac79-10c4-4e05-9011-c12fc68f5fa8'} Jul 16 12:59:12.454534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. (HTTP 404) (Request-ID: req-761cb083-88d6-4ee4-a3ae-63038a520eb6) Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.455489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 16 12:59:12.457583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 16 12:59:12.458964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1bab4049-34c0-4d77-b48d-480636ba2601 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Returning 404 to user: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1bab4049-34c0-4d77-b48d-480636ba2601 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 404 len: 109 microversion: 2.1 time: 0.036248 Jul 16 12:59:12.460494 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 471/930] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:59:12 2022] DELETE /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:12.464632 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ea177785-b91a-4cc3-baa9-e6e4b080e7b0 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Calling method '.version_select at 0x7f6cf8bea3a0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:12.491553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-ea177785-b91a-4cc3-baa9-e6e4b080e7b0 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] HTTP exception thrown: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ea177785-b91a-4cc3-baa9-e6e4b080e7b0 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Request method failure captured: Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 HTTP/1.1 Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rYV7wrPfgIAoD0SWADW3U3gsGjB3YnIruHX0cuyFEZE5XPkdK2IFC6YAXgKyEsJsjhEUS6EiyTfs2jLuaebhs2qBoqtcv9ugOjTID2-QRHonpv5epgjr47FV_Py6jQQoh9Iyil1KH5ALhrs3YnTd0rqQ0CTR3nBDiCi6-HRnNH-3PE Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:12.493502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_185422595a1e4037afa71e49c8837f96", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/185422595a1e4037afa71e49c8837f96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/185422595a1e4037afa71e49c8837f96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 185422595a1e4037afa71e49c8837f96 Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-120414108 Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: ec4bec9d38704e4b92ad06336f3a7a3c Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesSnapshotsTestJSON-120414108-project Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '7088ac79-10c4-4e05-9011-c12fc68f5fa8'} Jul 16 12:59:12.495067 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. (HTTP 404) (Request-ID: req-65fdb9e1-848d-4636-8f1b-a33889dbda9b) Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.496063 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:12.497521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 16 12:59:12.499073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ea177785-b91a-4cc3-baa9-e6e4b080e7b0 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] Returning 404 to user: Volume 7088ac79-10c4-4e05-9011-c12fc68f5fa8 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ea177785-b91a-4cc3-baa9-e6e4b080e7b0 tempest-VolumesSnapshotsTestJSON-120414108 tempest-VolumesSnapshotsTestJSON-120414108-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8" status: 404 len: 109 microversion: 2.1 time: 0.034010 Jul 16 12:59:12.500445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 460/931] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:12 2022] GET /compute/v2.1/os-volumes/7088ac79-10c4-4e05-9011-c12fc68f5fa8 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:14.585935 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c2f23110-408d-48ed-a0ed-40de4054ebf0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Action: 'create', calling method: .version_select at 0x7f6cf8c67a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1445359987", "metadata": {"Type": "work"}}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c2f23110-408d-48ed-a0ed-40de4054ebf0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Request method failure captured: Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 122 Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rYien0ribcdJHExnUbnqryHrzUeKNPSJEkyVbO_M3FpzwYB4pH9DdyivmdbeH82Td_3ljmEgYO7nJP0Yp9Y1AcReQKYfqIhCXzKm7Kzf4khoF_LN9u9zJxt8jD0DzdZ94kK7_czNjFJVkYLtoR7dyE4YVCO6m0Ym3U7JzuIXskMObc Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:14.604097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7062b770b1144534931c2357c27e15ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7062b770b1144534931c2357c27e15ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: d44cb290ef8c4b1a96d4e918d6c3468b Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1445359987", "metadata": {"Type": "work"}}} Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: Jul 16 12:59:14.606291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1445359987', 'metadata': {'Type': 'work'}}}} Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise error Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi '#$%' Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:14.607280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 16 12:59:14.609110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 16 12:59:14.610524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 16 12:59:14.610524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.610524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c2f23110-408d-48ed-a0ed-40de4054ebf0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:14.610524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c2f23110-408d-48ed-a0ed-40de4054ebf0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142277 Jul 16 12:59:14.610524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 472/932] 10.222.0.47 () {60 vars in 1155 bytes} [Sat Jul 16 12:59:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:59:14.612583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:59:14.613534 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:59:14.618644 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1fdb34a2-1c5e-41e8-9458-45a3421edd0a tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Action: 'create', calling method: .version_select at 0x7f6cf8d04f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-483443182", "metadata": {"Type": "work"}}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1fdb34a2-1c5e-41e8-9458-45a3421edd0a tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Request method failure captured: Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 119 Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rYien0ribcdJHExnUbnqryHrzUeKNPSJEkyVbO_M3FpzwYB4pH9DdyivmdbeH82Td_3ljmEgYO7nJP0Yp9Y1AcReQKYfqIhCXzKm7Kzf4khoF_LN9u9zJxt8jD0DzdZ94kK7_czNjFJVkYLtoR7dyE4YVCO6m0Ym3U7JzuIXskMObc Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:14.621812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7062b770b1144534931c2357c27e15ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7062b770b1144534931c2357c27e15ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: d44cb290ef8c4b1a96d4e918d6c3468b Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-483443182", "metadata": {"Type": "work"}}} Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: Jul 16 12:59:14.628955 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-483443182', 'metadata': {'Type': 'work'}}}} Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise error Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi '0' Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:14.630269 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 16 12:59:14.632194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 16 12:59:14.633587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 16 12:59:14.633587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.633587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1fdb34a2-1c5e-41e8-9458-45a3421edd0a tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:14.633587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1fdb34a2-1c5e-41e8-9458-45a3421edd0a tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011471 Jul 16 12:59:14.633587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 461/933] 10.222.0.47 () {60 vars in 1155 bytes} [Sat Jul 16 12:59:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 16 12:59:14.633979 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:59:14.636797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8ba6091c-f36e-4f8f-bccc-4832252f66d7 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Action: 'create', calling method: .version_select at 0x7f6cf8c1caf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-901900305", "metadata": {"Type": "work"}}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8ba6091c-f36e-4f8f-bccc-4832252f66d7 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Request method failure captured: Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 118 Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rYien0ribcdJHExnUbnqryHrzUeKNPSJEkyVbO_M3FpzwYB4pH9DdyivmdbeH82Td_3ljmEgYO7nJP0Yp9Y1AcReQKYfqIhCXzKm7Kzf4khoF_LN9u9zJxt8jD0DzdZ94kK7_czNjFJVkYLtoR7dyE4YVCO6m0Ym3U7JzuIXskMObc Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:14.639323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7062b770b1144534931c2357c27e15ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7062b770b1144534931c2357c27e15ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: d44cb290ef8c4b1a96d4e918d6c3468b Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-901900305", "metadata": {"Type": "work"}}} Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: Jul 16 12:59:14.640861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-901900305', 'metadata': {'Type': 'work'}}}} Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise error Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi '' Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:14.641883 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 16 12:59:14.643212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 16 12:59:14.645768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 16 12:59:14.645768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.645768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8ba6091c-f36e-4f8f-bccc-4832252f66d7 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:14.645768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8ba6091c-f36e-4f8f-bccc-4832252f66d7 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008579 Jul 16 12:59:14.645768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 473/934] 10.222.0.47 () {60 vars in 1155 bytes} [Sat Jul 16 12:59:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:59:14.651612 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b6c3cd5b-2785-4bb7-b9ba-bb591b0f39f0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Calling method '.version_select at 0x7f6cf8cde310>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:14.684814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-b6c3cd5b-2785-4bb7-b9ba-bb591b0f39f0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] HTTP exception thrown: Volume tempest-invalid-255494503 could not be found. Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b6c3cd5b-2785-4bb7-b9ba-bb591b0f39f0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Request method failure captured: Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-255494503 HTTP/1.1 Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rYien0ribcdJHExnUbnqryHrzUeKNPSJEkyVbO_M3FpzwYB4pH9DdyivmdbeH82Td_3ljmEgYO7nJP0Yp9Y1AcReQKYfqIhCXzKm7Kzf4khoF_LN9u9zJxt8jD0DzdZ94kK7_czNjFJVkYLtoR7dyE4YVCO6m0Ym3U7JzuIXskMObc Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:14.686802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7062b770b1144534931c2357c27e15ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7062b770b1144534931c2357c27e15ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: d44cb290ef8c4b1a96d4e918d6c3468b Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Volume tempest-invalid-255494503 could not be found. Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'tempest-invalid-255494503'} Jul 16 12:59:14.688596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-255494503 could not be found. (HTTP 404) (Request-ID: req-50a667eb-7224-46c3-9be6-e40229165504) Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.689620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 16 12:59:14.691599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-255494503 could not be found. Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:14.692966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-255494503 could not be found. Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-255494503 could not be found. Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b6c3cd5b-2785-4bb7-b9ba-bb591b0f39f0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Returning 404 to user: Volume tempest-invalid-255494503 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b6c3cd5b-2785-4bb7-b9ba-bb591b0f39f0 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-255494503" status: 404 len: 98 microversion: 2.1 time: 0.041668 Jul 16 12:59:14.695061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 462/935] 10.222.0.47 () {58 vars in 1214 bytes} [Sat Jul 16 12:59:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-255494503 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 16 12:59:14.700841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0682664b-e30c-42a1-94f1-e4936ff66254 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004450 Jul 16 12:59:14.701378 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 474/936] 10.222.0.47 () {58 vars in 1139 bytes} [Sat Jul 16 12:59:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 16 12:59:14.711930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5e39fd18-a592-46c0-900b-b60ac75ef159 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005515 Jul 16 12:59:14.712428 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 463/937] 10.222.0.47 () {58 vars in 1136 bytes} [Sat Jul 16 12:59:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 16 12:59:14.721226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c13a611d-e87e-4aef-8f60-78f17a537770 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Calling method '.version_select at 0x7f6cf8c800d0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:14.749848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-c13a611d-e87e-4aef-8f60-78f17a537770 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] HTTP exception thrown: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c13a611d-e87e-4aef-8f60-78f17a537770 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Request method failure captured: Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: DELETE /compute/v2.1/os-volumes/a53f8d8c-5b70-44f1-a656-a0e121eabc4b HTTP/1.1 Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rYien0ribcdJHExnUbnqryHrzUeKNPSJEkyVbO_M3FpzwYB4pH9DdyivmdbeH82Td_3ljmEgYO7nJP0Yp9Y1AcReQKYfqIhCXzKm7Kzf4khoF_LN9u9zJxt8jD0DzdZ94kK7_czNjFJVkYLtoR7dyE4YVCO6m0Ym3U7JzuIXskMObc Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:14.752101 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7062b770b1144534931c2357c27e15ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7062b770b1144534931c2357c27e15ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: d44cb290ef8c4b1a96d4e918d6c3468b Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'a53f8d8c-5b70-44f1-a656-a0e121eabc4b'} Jul 16 12:59:14.754533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. (HTTP 404) (Request-ID: req-74cd433d-424f-4dfd-90bf-7d968471fb27) Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.755396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 16 12:59:14.756732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 16 12:59:14.758420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c13a611d-e87e-4aef-8f60-78f17a537770 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Returning 404 to user: Volume a53f8d8c-5b70-44f1-a656-a0e121eabc4b could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c13a611d-e87e-4aef-8f60-78f17a537770 tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/a53f8d8c-5b70-44f1-a656-a0e121eabc4b" status: 404 len: 109 microversion: 2.1 time: 0.036677 Jul 16 12:59:14.759725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 475/938] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:59:14 2022] DELETE /compute/v2.1/os-volumes/a53f8d8c-5b70-44f1-a656-a0e121eabc4b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 16 12:59:14.764957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1ba9a19e-09fd-4c05-b293-19e6472dabdb tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Calling method '.version_select at 0x7f6cf8cc9af0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:14.798498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-1ba9a19e-09fd-4c05-b293-19e6472dabdb tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] HTTP exception thrown: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1ba9a19e-09fd-4c05-b293-19e6472dabdb tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Request method failure captured: Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/os-volumes/adf76d89-c420-4f06-8660-65ba80cc0a9e HTTP/1.1 Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rYien0ribcdJHExnUbnqryHrzUeKNPSJEkyVbO_M3FpzwYB4pH9DdyivmdbeH82Td_3ljmEgYO7nJP0Yp9Y1AcReQKYfqIhCXzKm7Kzf4khoF_LN9u9zJxt8jD0DzdZ94kK7_czNjFJVkYLtoR7dyE4YVCO6m0Ym3U7JzuIXskMObc Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:14.800670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_7062b770b1144534931c2357c27e15ba", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/7062b770b1144534931c2357c27e15ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/7062b770b1144534931c2357c27e15ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 7062b770b1144534931c2357c27e15ba Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesNegativeTest-553421016 Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: d44cb290ef8c4b1a96d4e918d6c3468b Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesNegativeTest-553421016-project Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'adf76d89-c420-4f06-8660-65ba80cc0a9e'} Jul 16 12:59:14.805097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. (HTTP 404) (Request-ID: req-3d2794bb-6801-428b-b922-12c56ee00f78) Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.806004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:14.807306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 16 12:59:14.808680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1ba9a19e-09fd-4c05-b293-19e6472dabdb tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] Returning 404 to user: Volume adf76d89-c420-4f06-8660-65ba80cc0a9e could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1ba9a19e-09fd-4c05-b293-19e6472dabdb tempest-VolumesNegativeTest-553421016 tempest-VolumesNegativeTest-553421016-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/adf76d89-c420-4f06-8660-65ba80cc0a9e" status: 404 len: 109 microversion: 2.1 time: 0.042350 Jul 16 12:59:14.810139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 464/939] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:14 2022] GET /compute/v2.1/os-volumes/adf76d89-c420-4f06-8660-65ba80cc0a9e => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:17.131838 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:59:17.136948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:17.137778 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:17.145649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:17.146124 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:17.146988 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:17.147669 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:17.229730 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lazy-loading 'services' on Instance uuid 71378833-c158-4caf-a822-19bc540ecaae {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:59:17.447359 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-261f5310-5635-49a1-886f-d4469aa42a06 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments/0016f47c-f24c-4be8-ae5d-91c214d6140b" status: 202 len: 0 microversion: 2.1 time: 0.315960 Jul 16 12:59:17.451144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 476/940] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 12:59:17 2022] DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments/0016f47c-f24c-4be8-ae5d-91c214d6140b => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:59:17.459556 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:17.460549 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:17.468267 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:17.468712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:17.469499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:17.469930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:17.501019 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1f56f83f-440f-45e0-9b29-6143c2418521 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Jul 16 12:59:17.501601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 465/941] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:59:17 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:59:18.513806 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:18.514797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:18.521701 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:18.522139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:18.522899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:18.523330 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:18.559233 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-06a285f9-d196-46dc-a572-fe824789745c tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050018 Jul 16 12:59:18.559800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 477/942] 10.222.0.47 () {58 vars in 1301 bytes} [Sat Jul 16 12:59:18 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 16 12:59:18.621587 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:18.622101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:18.628548 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:18.628996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:18.630427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:18.630867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:18.656616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:59:19.001371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7bdab7c4-29f0-4b1a-8cca-10717924cdd2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 204 len: 0 microversion: 2.1 time: 0.383406 Jul 16 12:59:19.001959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 466/943] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:59:18 2022] DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 12:59:19.010132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:19.012311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:19.016934 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:19.017410 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:19.018160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:19.018588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:19.313342 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:19.321600 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c56fcd23-3e7b-49af-978f-4f229f827d81 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1681 microversion: 2.1 time: 0.315189 Jul 16 12:59:19.322164 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 478/944] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:19 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1681 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:59:20.340307 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:20.340967 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:20.347448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:20.347896 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:20.349733 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:20.350169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:20.488607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:20.496456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-93845a33-ef93-43c6-882f-9a32ef667354 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1681 microversion: 2.1 time: 0.160571 Jul 16 12:59:20.497009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 467/945] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:20 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:59:21.519289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:21.519830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:21.527094 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:21.527537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:21.528322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:21.528745 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:21.617737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:21.625937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ae00947a-26fa-41aa-bce6-1793fc51d2a9 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1614 microversion: 2.1 time: 0.110383 Jul 16 12:59:21.626877 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 479/946] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:21 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1614 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:59:21.891472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-ab368e7f-1591-4562-95bf-69eb28cf40cd req-b1fc84ea-2e5f-40cd-9003-ed4812ff32f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71378833-c158-4caf-a822-19bc540ecaae", "name": "network-vif-deleted", "tag": "eb6e1a8d-0d7a-4d56-887e-3fff249540b1"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:21.901004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ab368e7f-1591-4562-95bf-69eb28cf40cd req-b1fc84ea-2e5f-40cd-9003-ed4812ff32f7 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:21.901493 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-ab368e7f-1591-4562-95bf-69eb28cf40cd req-b1fc84ea-2e5f-40cd-9003-ed4812ff32f7 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:21.913449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-ab368e7f-1591-4562-95bf-69eb28cf40cd req-b1fc84ea-2e5f-40cd-9003-ed4812ff32f7 service nova] Creating event network-vif-deleted:eb6e1a8d-0d7a-4d56-887e-3fff249540b1 for instance 71378833-c158-4caf-a822-19bc540ecaae on hv-cinder-83697 Jul 16 12:59:21.918332 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-ab368e7f-1591-4562-95bf-69eb28cf40cd req-b1fc84ea-2e5f-40cd-9003-ed4812ff32f7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Jul 16 12:59:21.918973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 468/947] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:59:22.643777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:22.646304 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:22.660160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:22.660697 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:22.662508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:22.662949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:22.697893 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:22.698323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:22.698780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lazy-loading 'fault' on Instance uuid 71378833-c158-4caf-a822-19bc540ecaae {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:59:22.752117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628e662a3b49438f9930a2d160658b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bb5db6207441a1b5030af42f291666', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:22.763512 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a7e829e5-7e7f-4134-8d1d-b5df69114b6d tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 200 len: 1331 microversion: 2.1 time: 0.123554 Jul 16 12:59:22.764581 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 480/948] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:22 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:59:23.783016 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:23.783634 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:23.790895 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:23.791341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:23.792100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:23.792529 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:23.809347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae HTTP/1.1 Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:23.811147 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:23.812964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '71378833-c158-4caf-a822-19bc540ecaae'} Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:23.814034 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:23.815380 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:23.816623 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:23.816623 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-31a07868-7c7b-4513-88d3-96a8fbf94d4a tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 404 len: 111 microversion: 2.1 time: 0.034567 Jul 16 12:59:23.816623 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 469/949] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:23 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:23.821544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b50dd817-ee25-4ba1-9172-f496e2011577 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '.version_select at 0x7f6cf8cbd4c0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:23.939480 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b50dd817-ee25-4ba1-9172-f496e2011577 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626859795" status: 202 len: 0 microversion: 2.1 time: 0.121645 Jul 16 12:59:23.940061 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 481/950] 10.222.0.47 () {58 vars in 1217 bytes} [Sat Jul 16 12:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626859795 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:59:25.936148 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:25.936669 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:25.943449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:25.943924 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:25.944686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:25.945151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:25.959444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae HTTP/1.1 Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:25.961257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.964845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '71378833-c158-4caf-a822-19bc540ecaae'} Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:25.965780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.967543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:25.969128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:25.969128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-853c0f50-68a2-4371-b077-8e12db76fcb4 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 404 len: 111 microversion: 2.1 time: 0.030566 Jul 16 12:59:25.969128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 470/951] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:59:25 2022] DELETE /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:25.972280 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:25.972930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 71378833-c158-4caf-a822-19bc540ecaae] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:25.980249 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:25.980705 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:25.981514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:25.981956 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:25.995621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae HTTP/1.1 Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:25.997464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:25.999081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '71378833-c158-4caf-a822-19bc540ecaae'} Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:26.002993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. Jul 16 12:59:26.004399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:26.006382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 71378833-c158-4caf-a822-19bc540ecaae could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:26.006382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7ff2442c-f773-4085-8cc1-46ace0e3f1cc tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae" status: 404 len: 111 microversion: 2.1 time: 0.031303 Jul 16 12:59:26.006382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 482/952] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:25 2022] GET /compute/v2.1/servers/71378833-c158-4caf-a822-19bc540ecaae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:31.474074 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:31.475089 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:31.481753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.482208 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.482980 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.483417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.497445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 HTTP/1.1 Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:31.499032 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.500476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '87b69d9d-a0a8-472f-86da-9608601291a3'} Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:31.501278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.502940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.504996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:31.504996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8e15c2e9-b5b4-41f1-ad97-a4c60be607b6 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 404 len: 111 microversion: 2.1 time: 0.030432 Jul 16 12:59:31.504996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 471/953] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:59:31 2022] DELETE /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:31.515862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:31.516482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 87b69d9d-a0a8-472f-86da-9608601291a3] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:31.523748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.524199 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.524960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.525420 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.538693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 HTTP/1.1 Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:31.540230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.542059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '87b69d9d-a0a8-472f-86da-9608601291a3'} Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:31.542829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. Jul 16 12:59:31.544078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.546047 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 87b69d9d-a0a8-472f-86da-9608601291a3 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:31.546047 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-70f2120d-4987-4662-9cc4-bdb18ed3689f tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3" status: 404 len: 111 microversion: 2.1 time: 0.029677 Jul 16 12:59:31.546047 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 483/954] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:31 2022] GET /compute/v2.1/servers/87b69d9d-a0a8-472f-86da-9608601291a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:31.550320 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:31.550810 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:31.557710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.558154 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.558912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.559407 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.574383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 HTTP/1.1 Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:31.575964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.577662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'cc230ed2-1599-4afc-91fb-7db62d977189'} Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:31.581670 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.584607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.586368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:31.586368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-df0c99d8-24f9-421f-89e4-65923efc2cd8 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 404 len: 111 microversion: 2.1 time: 0.030992 Jul 16 12:59:31.586368 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 472/955] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:59:31 2022] DELETE /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:31.586677 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:31.586677 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: cc230ed2-1599-4afc-91fb-7db62d977189] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:31.592186 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.592662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.593528 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:31.593959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:31.607220 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 HTTP/1.1 Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:31.608734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.616361 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'cc230ed2-1599-4afc-91fb-7db62d977189'} Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:31.618136 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. Jul 16 12:59:31.620235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:31.621941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance cc230ed2-1599-4afc-91fb-7db62d977189 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:31.621941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-343fd46d-6136-465f-992a-3cc945e05203 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189" status: 404 len: 111 microversion: 2.1 time: 0.028275 Jul 16 12:59:31.621941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 484/956] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:31 2022] GET /compute/v2.1/servers/cc230ed2-1599-4afc-91fb-7db62d977189 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:32.865347 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:32.865843 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:32.872143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:32.872584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:32.873369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:32.873798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:32.887426 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 HTTP/1.1 Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:32.888977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.890622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '0f070ffc-5fc4-42f9-b2e5-d8420a80af13'} Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:32.891400 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.892621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.894310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:32.894310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a4a938c1-a03e-4dce-baf6-89dd657241d2 tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 404 len: 111 microversion: 2.1 time: 0.029341 Jul 16 12:59:32.894310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 473/957] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 12:59:32 2022] DELETE /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:32.898780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:32.899400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] [instance: 0f070ffc-5fc4-42f9-b2e5-d8420a80af13] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:32.906203 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:32.906649 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:32.907455 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:32.907892 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:32.921448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] HTTP exception thrown: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Request method failure captured: Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 HTTP/1.1 Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rPAXcJk30UlIIYgk4gSnaouh-3suZ--aGuR1TK1FC95wDdPxiwY7B8LGQvEx0XQe0OEi3kbRawzW2Y6CXsdG1900upWpIXzg-CtVa5fXlPhHII3iD3ica6xtmwBuY5u8cqWHT0drtYwLMAGHaHBDO38wOBfP1JcSl9aP8SNZj4dNXE Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:32.922985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a3bb5db6207441a1b5030af42f291666", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a3bb5db6207441a1b5030af42f291666"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a3bb5db6207441a1b5030af42f291666 Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-754498825 Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 628e662a3b49438f9930a2d160658b7c Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeNegativeTest-754498825-project Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.924315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '0f070ffc-5fc4-42f9-b2e5-d8420a80af13'} Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:32.926555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. Jul 16 12:59:32.927863 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:32.929068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] Returning 404 to user: Instance 0f070ffc-5fc4-42f9-b2e5-d8420a80af13 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:32.929068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5e4f73e9-d93f-4c61-94af-a3da8cd73afa tempest-AttachVolumeNegativeTest-754498825 tempest-AttachVolumeNegativeTest-754498825-project] 10.222.0.47 "GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13" status: 404 len: 111 microversion: 2.1 time: 0.029606 Jul 16 12:59:32.929068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 485/958] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 12:59:32 2022] GET /compute/v2.1/servers/0f070ffc-5fc4-42f9-b2e5-d8420a80af13 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:34.307126 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:34.308013 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:34.315479 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:34.316146 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:34.317417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:34.318787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:34.350104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d8f090b2-aa31-4e2d-be67-4b796517d2a2 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047137 Jul 16 12:59:34.350958 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 474/959] 10.222.0.47 () {60 vars in 1342 bytes} [Sat Jul 16 12:59:34 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 12:59:34.423573 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:34.427104 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:34.431611 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:34.432113 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:34.433112 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:34.433732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:34.466129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 12:59:34.820045 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2de552b8-c4de-4e03-a598-0de17e87abec tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 204 len: 0 microversion: 2.20 time: 0.399764 Jul 16 12:59:34.824766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 486/960] 10.222.0.47 () {60 vars in 1279 bytes} [Sat Jul 16 12:59:34 2022] DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 16 12:59:34.830584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:34.831284 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:34.838826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:34.839531 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:34.840475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:34.841099 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:34.985030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:34.996601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:35.001427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:35.020411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-49f19a62-9b3c-4fd5-ab56-640970da2b00 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.177391 Jul 16 12:59:35.020411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 475/961] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:34 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:59:36.029533 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:36.030388 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:36.036975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:36.037733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:36.038744 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:36.039354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:36.236799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:36.245528 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:36.247181 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:36.248352 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3d6f227e-387b-4f45-baab-74fa81db6888 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1723 microversion: 2.20 time: 0.223236 Jul 16 12:59:36.248903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 487/962] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:36 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:59:37.268851 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:37.269692 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:37.278929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:37.278929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:37.279120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:37.279487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:37.352431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:37.363137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:37.365080 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:37.366543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a6ee0ab2-0d5b-4b96-8de2-a37b0dbbd5e1 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1656 microversion: 2.20 time: 0.103685 Jul 16 12:59:37.378340 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 476/963] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:37 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1656 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:59:37.478959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-202bb03b-6db7-4671-8b62-c2879e29744a req-46c878ce-bd55-4f19-b8d8-4398d70715ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b82d74b-e87f-404e-b369-5bd7955f6318", "name": "network-vif-deleted", "tag": "8a390625-6257-4d3b-a1a4-2f8ae239dbf9"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:37.491587 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-202bb03b-6db7-4671-8b62-c2879e29744a req-46c878ce-bd55-4f19-b8d8-4398d70715ba service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:37.492051 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-202bb03b-6db7-4671-8b62-c2879e29744a req-46c878ce-bd55-4f19-b8d8-4398d70715ba service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:37.504460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-202bb03b-6db7-4671-8b62-c2879e29744a req-46c878ce-bd55-4f19-b8d8-4398d70715ba service nova] Creating event network-vif-deleted:8a390625-6257-4d3b-a1a4-2f8ae239dbf9 for instance 5b82d74b-e87f-404e-b369-5bd7955f6318 on hv-cinder-83697 Jul 16 12:59:37.510712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-202bb03b-6db7-4671-8b62-c2879e29744a req-46c878ce-bd55-4f19-b8d8-4398d70715ba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035145 Jul 16 12:59:37.511767 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 488/964] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 12:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:38.386800 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:38.389601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:38.395621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:38.396605 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:38.397988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:38.398608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:38.443093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:38.443945 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:38.444824 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lazy-loading 'fault' on Instance uuid 5b82d74b-e87f-404e-b369-5bd7955f6318 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 12:59:38.500582 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:38.518590 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:38.520497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e12d902f94b40cea088dc6f24dcb444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f762c3c164904a3bb6e64985744c1765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 12:59:38.521888 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ba20dd85-61fb-4f23-8e45-2a10b1609ef9 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 200 len: 1371 microversion: 2.20 time: 0.139695 Jul 16 12:59:38.522451 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 477/965] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:38 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 1371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 16 12:59:39.428693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6cd3db50-8cc2-48ea-9964-d781d34f53f6 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Action: 'create', calling method: .version_select at 0x7f6cf8c95b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-667730869", "metadata": {"Type": "work"}}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 12:59:39.542805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:39.543532 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:39.549852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:39.553788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:39.553788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:39.553788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:39.565639 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] HTTP exception thrown: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Request method failure captured: Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 HTTP/1.1 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO7JGIK9L37zHSxJYihPAkwixb6DhgGcdj_Ar1nRHORx7uPBDEBk7TMAnfDj_NLvaoqqFUe5XYi7QtUrwKmqG4_YnVzZdiEwH8l-uFyEshydc4UltVjJ8UzerSSkCwiWEK-0Fp6maWlZ28I7EitKBV4ah_GsQWhYVICE4m6Fn1qpU8 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Openstack-Nova-Api-Version: 2.20 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:39.567375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f762c3c164904a3bb6e64985744c1765", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 3e12d902f94b40cea088dc6f24dcb444 Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:39.569196 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '5b82d74b-e87f-404e-b369-5bd7955f6318'} Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:39.570076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:39.572565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:39.584144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Returning 404 to user: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:39.584144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c05939b4-7d9b-47ed-aa3a-1451a8cf39c4 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 404 len: 111 microversion: 2.20 time: 0.030084 Jul 16 12:59:39.584144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 478/966] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:39 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:59:39.584144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c6d5fa8f-daaf-47c0-aeab-323ee4618134 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '.version_select at 0x7f6cf8ed65e0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:39.682722 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c6d5fa8f-daaf-47c0-aeab-323ee4618134 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-670959870" status: 204 len: 0 microversion: 2.20 time: 0.108182 Jul 16 12:59:39.683329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 479/967] 10.222.0.47 () {60 vars in 1258 bytes} [Sat Jul 16 12:59:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-670959870 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 16 12:59:40.101721 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6cd3db50-8cc2-48ea-9964-d781d34f53f6 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.786541 Jul 16 12:59:40.102491 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 489/968] 10.222.0.47 () {60 vars in 1155 bytes} [Sat Jul 16 12:59:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 788 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 16 12:59:40.113689 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a316d97c-9ec4-45fc-9336-fa185fdd9ec3 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8da2700>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:40.165796 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a316d97c-9ec4-45fc-9336-fa185fdd9ec3 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 352 microversion: 2.1 time: 0.056105 Jul 16 12:59:40.166458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 480/969] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:40 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 12:59:41.178579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d3e48de1-6c70-4df9-afa2-7b950127d705 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8c54280>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:41.228256 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d3e48de1-6c70-4df9-afa2-7b950127d705 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 353 microversion: 2.1 time: 0.054167 Jul 16 12:59:41.228912 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 490/970] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:41 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:41.240883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a3449844-073b-40e2-b1d8-fa9d96f6e6fb tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf9046940>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:41.293528 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a3449844-073b-40e2-b1d8-fa9d96f6e6fb tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 353 microversion: 2.1 time: 0.057020 Jul 16 12:59:41.294104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 481/971] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:41 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:41.311054 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f1ec2302-a7f3-4fd1-8c07-16a685fd2e7e tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8cbd670>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:41.524820 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f1ec2302-a7f3-4fd1-8c07-16a685fd2e7e tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 202 len: 0 microversion: 2.1 time: 0.217443 Jul 16 12:59:41.525376 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 491/972] 10.222.0.47 () {58 vars in 1247 bytes} [Sat Jul 16 12:59:41 2022] DELETE /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 12:59:41.534143 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-98b59ee7-4113-44d5-9a7b-c22e70198b0b tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8bda790>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:41.581101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-98b59ee7-4113-44d5-9a7b-c22e70198b0b tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 352 microversion: 2.1 time: 0.050939 Jul 16 12:59:41.581737 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 482/973] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:41 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:41.782945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:41.783552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:41.789896 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:41.790356 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:41.791103 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:41.791532 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:41.805341 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] HTTP exception thrown: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Request method failure captured: Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 HTTP/1.1 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO7JGIK9L37zHSxJYihPAkwixb6DhgGcdj_Ar1nRHORx7uPBDEBk7TMAnfDj_NLvaoqqFUe5XYi7QtUrwKmqG4_YnVzZdiEwH8l-uFyEshydc4UltVjJ8UzerSSkCwiWEK-0Fp6maWlZ28I7EitKBV4ah_GsQWhYVICE4m6Fn1qpU8 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Openstack-Nova-Api-Version: 2.20 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:41.806993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f762c3c164904a3bb6e64985744c1765", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 3e12d902f94b40cea088dc6f24dcb444 Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.814033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '5b82d74b-e87f-404e-b369-5bd7955f6318'} Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:41.814927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.816358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.818687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Returning 404 to user: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:41.818687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-18752e30-7978-4fca-849a-e5a15f67e2e3 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 404 len: 111 microversion: 2.20 time: 0.029269 Jul 16 12:59:41.818687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 492/974] 10.222.0.47 () {60 vars in 1279 bytes} [Sat Jul 16 12:59:41 2022] DELETE /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:59:41.824270 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:41.824878 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 5b82d74b-e87f-404e-b369-5bd7955f6318] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:41.831100 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:41.831556 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:41.832326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:41.832787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:41.846193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] HTTP exception thrown: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Request method failure captured: Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 HTTP/1.1 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO7JGIK9L37zHSxJYihPAkwixb6DhgGcdj_Ar1nRHORx7uPBDEBk7TMAnfDj_NLvaoqqFUe5XYi7QtUrwKmqG4_YnVzZdiEwH8l-uFyEshydc4UltVjJ8UzerSSkCwiWEK-0Fp6maWlZ28I7EitKBV4ah_GsQWhYVICE4m6Fn1qpU8 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Openstack-Nova-Api-Version: 2.20 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:41.847767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f762c3c164904a3bb6e64985744c1765", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 3e12d902f94b40cea088dc6f24dcb444 Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.849731 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '5b82d74b-e87f-404e-b369-5bd7955f6318'} Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:41.850651 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. Jul 16 12:59:41.851868 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:41.853081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Returning 404 to user: Instance 5b82d74b-e87f-404e-b369-5bd7955f6318 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:41.853081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-02ed2659-a28b-49ab-92a3-7b1997b9fc31 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318" status: 404 len: 111 microversion: 2.20 time: 0.028739 Jul 16 12:59:41.853081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 483/975] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:41 2022] GET /compute/v2.1/servers/5b82d74b-e87f-404e-b369-5bd7955f6318 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:59:42.594343 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bc41da9e-248d-4c5f-b8e5-8537c676d612 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8cbd0d0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:42.640273 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bc41da9e-248d-4c5f-b8e5-8537c676d612 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 352 microversion: 2.1 time: 0.049781 Jul 16 12:59:42.640865 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 493/976] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:42 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:43.652948 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-89321145-a3d8-48a6-a432-94e44905a99a tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8d19940>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:43.699869 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-89321145-a3d8-48a6-a432-94e44905a99a tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 352 microversion: 2.1 time: 0.050642 Jul 16 12:59:43.700445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 484/977] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:43 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:44.713189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ee65a7e8-7c7a-4c24-970a-e88dcb73fe25 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8c678b0>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:44.760012 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ee65a7e8-7c7a-4c24-970a-e88dcb73fe25 tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 200 len: 352 microversion: 2.1 time: 0.051689 Jul 16 12:59:44.760571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 494/978] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:44 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 12:59:45.773267 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9999d83c-5143-4eab-b46e-11491a71585c tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Calling method '.version_select at 0x7f6cf8da2700>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:45.800770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-9999d83c-5143-4eab-b46e-11491a71585c tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] HTTP exception thrown: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9999d83c-5143-4eab-b46e-11491a71585c tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Request method failure captured: Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa HTTP/1.1 Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rY7jZvsE-9k8SEbIG6FbGGZOm_UsJNMOKXUqC1hKtd7CS8bwihhj6uO-LI0yvg98WJbMlYMW2hNj92uyCl2fvHr4wmSjFL8vadDR09D8zhuBMQxR-FL_CCIfBwzRXFjAgntB0mRmP8LtnMN1XJ4ytvpSrtF51Z48jdgxo48ixG2bhw Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 44bc670e6a714cbc88a2a41990cec6ad Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesGetTestJSON-773597868 Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:45.803680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_44bc670e6a714cbc88a2a41990cec6ad", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/44bc670e6a714cbc88a2a41990cec6ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/44bc670e6a714cbc88a2a41990cec6ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/44bc670e6a714cbc88a2a41990cec6ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesGetTestJSON-773597868 Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 44bc670e6a714cbc88a2a41990cec6ad Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesGetTestJSON-773597868 Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesGetTestJSON-773597868-project Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: cdedf8957dd84ad3a2ca113a31b4d6d3 Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesGetTestJSON-773597868-project Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '3de394f3-3147-442f-80db-384394a46aaa'} Jul 16 12:59:45.805568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. (HTTP 404) (Request-ID: req-5358dd58-4ee7-4abc-a156-a94dec0bd1ca) Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:45.806480 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 16 12:59:45.807697 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 16 12:59:45.808931 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9999d83c-5143-4eab-b46e-11491a71585c tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] Returning 404 to user: Volume 3de394f3-3147-442f-80db-384394a46aaa could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9999d83c-5143-4eab-b46e-11491a71585c tempest-VolumesGetTestJSON-773597868 tempest-VolumesGetTestJSON-773597868-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa" status: 404 len: 109 microversion: 2.1 time: 0.037002 Jul 16 12:59:45.816345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 485/979] 10.222.0.47 () {58 vars in 1244 bytes} [Sat Jul 16 12:59:45 2022] GET /compute/v2.1/os-volumes/3de394f3-3147-442f-80db-384394a46aaa => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 12:59:46.248073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:46.248560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:46.256474 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:46.256926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:46.257737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:46.258412 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:46.272485 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] HTTP exception thrown: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Request method failure captured: Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d HTTP/1.1 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rO7JGIK9L37zHSxJYihPAkwixb6DhgGcdj_Ar1nRHORx7uPBDEBk7TMAnfDj_NLvaoqqFUe5XYi7QtUrwKmqG4_YnVzZdiEwH8l-uFyEshydc4UltVjJ8UzerSSkCwiWEK-0Fp6maWlZ28I7EitKBV4ah_GsQWhYVICE4m6Fn1qpU8 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Openstack-Nova-Api-Version: 2.20 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 12:59:46.274312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f762c3c164904a3bb6e64985744c1765", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 3e12d902f94b40cea088dc6f24dcb444 Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.275974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '80af442b-e294-4d43-9279-a6ee29d6325d'} Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:46.276781 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.278230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.279733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Returning 404 to user: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:46.279733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cc4ab620-3fdc-4924-9a36-d1da141c2431 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 404 len: 111 microversion: 2.20 time: 0.031479 Jul 16 12:59:46.279733 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 495/980] 10.222.0.47 () {60 vars in 1279 bytes} [Sat Jul 16 12:59:46 2022] DELETE /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 16 12:59:46.284479 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 12:59:46.285339 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] [instance: 80af442b-e294-4d43-9279-a6ee29d6325d] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 12:59:46.287643 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 12:59:46.303624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:46.303624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:46.303624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 12:59:46.303624 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 12:59:46.315732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] HTTP exception thrown: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Request method failure captured: Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d HTTP/1.1 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rO7JGIK9L37zHSxJYihPAkwixb6DhgGcdj_Ar1nRHORx7uPBDEBk7TMAnfDj_NLvaoqqFUe5XYi7QtUrwKmqG4_YnVzZdiEwH8l-uFyEshydc4UltVjJ8UzerSSkCwiWEK-0Fp6maWlZ28I7EitKBV4ah_GsQWhYVICE4m6Fn1qpU8 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Openstack-Nova-Api-Version: 2.20 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 12:59:46.318028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f762c3c164904a3bb6e64985744c1765", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f762c3c164904a3bb6e64985744c1765"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: f762c3c164904a3bb6e64985744c1765 Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1234180170 Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: 3e12d902f94b40cea088dc6f24dcb444 Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1234180170-project Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.319929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '80af442b-e294-4d43-9279-a6ee29d6325d'} Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 12:59:46.320724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. Jul 16 12:59:46.322133 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 12:59:46.323413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] Returning 404 to user: Instance 80af442b-e294-4d43-9279-a6ee29d6325d could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 12:59:46.323413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-acc4105b-62f1-4314-8a7c-561267fe9b24 tempest-AttachVolumeShelveTestJSON-1234180170 tempest-AttachVolumeShelveTestJSON-1234180170-project] 10.222.0.47 "GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d" status: 404 len: 111 microversion: 2.20 time: 0.038728 Jul 16 12:59:46.323413 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 486/981] 10.222.0.47 () {60 vars in 1276 bytes} [Sat Jul 16 12:59:46 2022] GET /compute/v2.1/servers/80af442b-e294-4d43-9279-a6ee29d6325d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 16 13:00:25.502817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:25.503545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:25.668270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:00:25.669228 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:25.675114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:25.675560 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:25.676323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:25.676758 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:27.273133 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-614d5e83-d0c5-4867-b3c4-f7c09845efd1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "POST /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2/action" status: 200 len: 62555 microversion: 2.1 time: 1.774862 Jul 16 13:00:27.273779 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 496/982] 10.222.0.47 () {60 vars in 1277 bytes} [Sat Jul 16 13:00:25 2022] POST /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2/action => generated 62555 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 16 13:00:28.167326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:28.167873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:28.171986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:28.176747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:28.185725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:28.185725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:28.185725 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:28.209167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:00:28.235597 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-67ee8ec8-19f2-489b-8442-b8cfa8e9f698 req-55675173-115d-471a-a6a0-63f3f6493f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:00:28.246434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-67ee8ec8-19f2-489b-8442-b8cfa8e9f698 req-55675173-115d-471a-a6a0-63f3f6493f2c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:28.246878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-67ee8ec8-19f2-489b-8442-b8cfa8e9f698 req-55675173-115d-471a-a6a0-63f3f6493f2c service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:28.257610 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-67ee8ec8-19f2-489b-8442-b8cfa8e9f698 req-55675173-115d-471a-a6a0-63f3f6493f2c service nova] Creating event network-changed:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 13:00:28.263260 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-67ee8ec8-19f2-489b-8442-b8cfa8e9f698 req-55675173-115d-471a-a6a0-63f3f6493f2c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097462 Jul 16 13:00:28.263859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 497/983] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 13:00:28.565262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-68e6eb23-3088-4015-8bc7-851f10dd5597 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 204 len: 0 microversion: 2.1 time: 0.402022 Jul 16 13:00:28.565860 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 487/984] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:00:28 2022] DELETE /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:00:28.580667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:28.581416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:28.588043 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:28.588500 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:28.589300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:28.589741 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:28.731816 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:28.739509 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d42254bf-689f-432d-8fe0-0f82db780192 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.163578 Jul 16 13:00:28.740674 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 498/985] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:28 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:29.759427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:29.760128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:29.766662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:29.767115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:29.767883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:29.768319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:29.900506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:29.907999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-87cb9df1-6aeb-41be-9562-80a8b7946baf tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.153802 Jul 16 13:00:29.908554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 488/986] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:29 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:30.926520 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:30.927121 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:30.934244 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:30.934687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:30.935431 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:30.935859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:31.063502 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:31.070871 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d2dd11ae-4436-411e-9286-d41efb7f945e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.148202 Jul 16 13:00:31.071936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 499/987] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:30 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:32.088890 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:32.089473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:32.095941 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:32.096389 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:32.097180 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:32.097621 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:32.232020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:32.239598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6007ee7d-b375-4798-97d0-acbe4da2cf6f tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1567 microversion: 2.1 time: 0.155186 Jul 16 13:00:32.240178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 489/988] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:32 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:33.258437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:33.259091 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:33.265768 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:33.266214 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:33.267048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:33.267479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:33.400266 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:33.408517 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2b8d1a9e-8388-4652-be9a-f5891431b552 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1449 microversion: 2.1 time: 0.153943 Jul 16 13:00:33.409088 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 500/989] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:33 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:34.190352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-60525ae2-0310-4b2a-a95d-753b09d6aa59 req-58b269dc-9fd1-46cf-abc2-21c8dfd6fa35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ab9284-64aa-4a43-b8ad-de31e2b6cff2", "name": "network-vif-deleted", "tag": "9e82d9b9-5cd3-4351-8677-5ed5aee1f916"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:00:34.204038 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-60525ae2-0310-4b2a-a95d-753b09d6aa59 req-58b269dc-9fd1-46cf-abc2-21c8dfd6fa35 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:34.205330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-60525ae2-0310-4b2a-a95d-753b09d6aa59 req-58b269dc-9fd1-46cf-abc2-21c8dfd6fa35 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:34.218487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-60525ae2-0310-4b2a-a95d-753b09d6aa59 req-58b269dc-9fd1-46cf-abc2-21c8dfd6fa35 service nova] Creating event network-vif-deleted:9e82d9b9-5cd3-4351-8677-5ed5aee1f916 for instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 on hv-cinder-83697 Jul 16 13:00:34.224020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-60525ae2-0310-4b2a-a95d-753b09d6aa59 req-58b269dc-9fd1-46cf-abc2-21c8dfd6fa35 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037438 Jul 16 13:00:34.224976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 490/990] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:00:34.425469 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:34.426147 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:34.433444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:34.433898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:34.434672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:34.435109 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:34.508210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:34.515747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ef99e620-6f72-4555-a5b3-a4e573977abe tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1218 microversion: 2.1 time: 0.094165 Jul 16 13:00:34.516399 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 501/991] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:34 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:35.534945 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:35.536077 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:35.543511 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:35.543790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:35.544566 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:35.545377 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:35.609901 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:35.610680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:35.611379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lazy-loading 'fault' on Instance uuid e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:00:35.663409 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8431eaa3717a4f798db80c9c87832273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73deeaa0bcd7498eae06c39dfc0e2e3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:35.671434 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4f64a8e5-9b5a-4f6e-9b98-94b4683fdbc1 tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 200 len: 1223 microversion: 2.1 time: 0.141994 Jul 16 13:00:35.672010 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 491/992] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:35 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:36.689371 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:36.689992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] [instance: e9ab9284-64aa-4a43-b8ad-de31e2b6cff2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:36.696516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:36.696969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:36.697818 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:36.698421 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:36.711808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] HTTP exception thrown: Instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 could not be found. Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Request method failure captured: Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 HTTP/1.1 Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rSOnh22KfRhNgs-E3AO5bBLwxhiJC2TdLJfxue2_LLSiTPyE56GuJnrpgmMjGkQ-df6fR2jTF32KIlzphgf0ppZS3fGocVeH5slReE1_bmoX7q8wnSUM5cClBvCF6AUbwDK1gtYaab-b-zxFoWncfHwvx5O2PJkx-HqIwOR57XI4C4 Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 73deeaa0bcd7498eae06c39dfc0e2e3b Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-TestShelveInstance-559968041 Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 13:00:36.713531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73deeaa0bcd7498eae06c39dfc0e2e3b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73deeaa0bcd7498eae06c39dfc0e2e3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73deeaa0bcd7498eae06c39dfc0e2e3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73deeaa0bcd7498eae06c39dfc0e2e3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-TestShelveInstance-559968041 Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 73deeaa0bcd7498eae06c39dfc0e2e3b Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-TestShelveInstance-559968041 Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-TestShelveInstance-559968041-project Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: 8431eaa3717a4f798db80c9c87832273 Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-TestShelveInstance-559968041-project Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 could not be found. Jul 16 13:00:36.716449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': 'e9ab9284-64aa-4a43-b8ad-de31e2b6cff2'} Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 could not be found. Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:00:36.717334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 could not be found. Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 could not be found. Jul 16 13:00:36.718742 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:00:36.719969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Returning 404 to user: Instance e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:00:36.719969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2c5919bc-29c2-4f42-bfbd-e05e8d4a3b0a tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2" status: 404 len: 111 microversion: 2.1 time: 0.030257 Jul 16 13:00:36.719969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 502/993] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:36 2022] GET /compute/v2.1/servers/e9ab9284-64aa-4a43-b8ad-de31e2b6cff2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:00:36.956245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-38b03b59-49f6-4d6f-a533-1d36b1d9a20e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] Calling method '.version_select at 0x7f6cf8ed6e50>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:37.059971 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-38b03b59-49f6-4d6f-a533-1d36b1d9a20e tempest-TestShelveInstance-559968041 tempest-TestShelveInstance-559968041-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-646467689" status: 202 len: 0 microversion: 2.1 time: 0.108162 Jul 16 13:00:37.060727 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 492/994] 10.222.0.47 () {58 vars in 1250 bytes} [Sat Jul 16 13:00:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-646467689 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 13:00:39.418654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-801100322", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "networks": [{"uuid": "a0a377a1-84de-453d-b40d-43d4720569f7"}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:00:39.472433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] validate_networks() for [('a0a377a1-84de-453d-b40d-43d4720569f7', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:00:39.942030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:00:39.942444 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:00:39.942916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:00:39.943312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:00:39.943715 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:00:39.953553 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:39.953992 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:39.954777 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:39.955229 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:39.972569 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Getting quotas for project ada92e33c07f4be7b2d752550c381dfb. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:00:39.976526 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Getting quotas for user c89a6bacbd004d99837d8d092352f18f and project ada92e33c07f4be7b2d752550c381dfb. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:00:39.987991 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:00:39.990544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:00:40.129869 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-68fc37a2-92e5-4b02-a49b-8eacab5d0b76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716845 Jul 16 13:00:40.130722 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 503/995] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:00:40.142585 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c3e246f6-a165-45e6-9ce9-c388b9c531d2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:40.143193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c3e246f6-a165-45e6-9ce9-c388b9c531d2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:40.209398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c3e246f6-a165-45e6-9ce9-c388b9c531d2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:40.216789 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c3e246f6-a165-45e6-9ce9-c388b9c531d2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1218 microversion: 2.1 time: 0.078685 Jul 16 13:00:40.217436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 493/996] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:40 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:41.234335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7bb38c67-f726-4a57-b24a-3a90991a10b3 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:41.234956 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7bb38c67-f726-4a57-b24a-3a90991a10b3 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:41.293198 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7bb38c67-f726-4a57-b24a-3a90991a10b3 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:41.300780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7bb38c67-f726-4a57-b24a-3a90991a10b3 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1218 microversion: 2.1 time: 0.071063 Jul 16 13:00:41.301635 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 504/997] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:41 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:42.320131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:42.320754 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:42.327463 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:42.327913 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:42.328690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:42.329152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:42.418137 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:42.425543 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-63bd2b80-c023-49f6-9321-983fe2543075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1214 microversion: 2.1 time: 0.110724 Jul 16 13:00:42.426108 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 494/998] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:42 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:43.442688 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:43.443233 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:43.450704 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:43.451156 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:43.451926 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:43.452366 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:43.516069 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:43.524270 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-00c76864-1ba6-425c-9a55-296e611035da tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1214 microversion: 2.1 time: 0.085455 Jul 16 13:00:43.524858 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 505/999] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:43 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:44.541490 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:44.542497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:44.549029 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:44.549498 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:44.550583 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:44.550702 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:44.640771 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:44.649200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-abed0ea2-e15c-4999-b4ae-e9fa52ebe13a tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1214 microversion: 2.1 time: 0.111737 Jul 16 13:00:44.650115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 495/1000] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:44 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:45.667535 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:45.668092 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:45.674747 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:45.675447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:45.677077 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:45.677749 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:45.768843 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:45.785690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-421e21a6-25a7-42a3-832f-a486ea995683 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1278 microversion: 2.1 time: 0.122575 Jul 16 13:00:45.786273 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 506/1001] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:45 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:46.808230 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:46.808781 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:46.815866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:46.816575 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:46.817599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:46.818242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:46.974712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:46.983303 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-64f49c93-e40c-45ad-a14a-e8d13a1d3239 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.179918 Jul 16 13:00:46.983877 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 496/1002] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:46 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:47.436542 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:00:47.436799 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:00:47.506968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-8709822e-a290-4e67-a85e-5e298dcea968 req-9fe0890c-6c3e-46a6-898c-560555bf2c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbef503f-9c60-44cf-83e4-2e202e8b9814", "tag": "dc8f5d80-75ce-41db-91d4-fc3a8154fcd9"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:00:47.516262 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-8709822e-a290-4e67-a85e-5e298dcea968 req-9fe0890c-6c3e-46a6-898c-560555bf2c19 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:47.516698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-8709822e-a290-4e67-a85e-5e298dcea968 req-9fe0890c-6c3e-46a6-898c-560555bf2c19 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:47.529207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-8709822e-a290-4e67-a85e-5e298dcea968 req-9fe0890c-6c3e-46a6-898c-560555bf2c19 service nova] Creating event network-changed:dc8f5d80-75ce-41db-91d4-fc3a8154fcd9 for instance dbef503f-9c60-44cf-83e4-2e202e8b9814 on hv-cinder-83697 Jul 16 13:00:47.534180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-8709822e-a290-4e67-a85e-5e298dcea968 req-9fe0890c-6c3e-46a6-898c-560555bf2c19 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031080 Jul 16 13:00:47.535003 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 507/1003] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:00:48.000198 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:48.000809 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:48.007410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:48.007859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:48.008622 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:48.009064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:48.356959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:48.356959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7c9022df-ca05-43f3-8929-01197b6ac426 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.154269 Jul 16 13:00:48.356959 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 497/1004] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:47 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:49.168131 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:49.168821 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:49.175643 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:49.176087 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:49.176847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:49.177305 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:49.309764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:49.317066 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3c1c929d-25bb-4bc6-b2b3-da9ed48b3075 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.153114 Jul 16 13:00:49.317614 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 508/1005] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:49 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:50.334306 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:50.334924 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:50.337304 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:50.342828 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:50.343283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:50.344052 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:50.344494 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:50.480274 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:50.488019 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-128fb6de-693b-4ad5-b3e6-2ad5c7076ead tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.157499 Jul 16 13:00:50.488592 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 498/1006] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:50 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:51.504454 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:51.505117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:51.507021 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:51.508160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=8 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:51.513151 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:51.513599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:51.514354 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:51.514789 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:51.646787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:51.654905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c9cc9530-2695-43b2-96bc-cd8589a89a76 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.154436 Jul 16 13:00:51.655464 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 509/1007] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:51 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:52.672850 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:52.673485 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:52.680109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:52.680549 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:52.681331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:52.681766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:52.823403 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:52.830893 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5bf3c7ea-ba67-4c48-9fbd-9034c257d5b5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.162020 Jul 16 13:00:52.831450 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 499/1008] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:52 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:53.848205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:53.848818 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:53.856154 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:53.857213 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:53.858178 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:53.858620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:53.999138 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:54.007425 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-da208818-3f1a-4331-8f3b-6cfc04961339 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.163635 Jul 16 13:00:54.008539 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 510/1009] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:53 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:54.232321 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-6db8924f-705f-4211-b7e0-831a0a216b94 req-46d2b87c-cf56-4544-93a5-b748b58541e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbef503f-9c60-44cf-83e4-2e202e8b9814", "name": "network-vif-plugged", "status": "completed", "tag": "dc8f5d80-75ce-41db-91d4-fc3a8154fcd9"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:00:54.241199 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-6db8924f-705f-4211-b7e0-831a0a216b94 req-46d2b87c-cf56-4544-93a5-b748b58541e6 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:54.241859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-6db8924f-705f-4211-b7e0-831a0a216b94 req-46d2b87c-cf56-4544-93a5-b748b58541e6 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:54.254429 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-6db8924f-705f-4211-b7e0-831a0a216b94 req-46d2b87c-cf56-4544-93a5-b748b58541e6 service nova] Creating event network-vif-plugged:dc8f5d80-75ce-41db-91d4-fc3a8154fcd9 for instance dbef503f-9c60-44cf-83e4-2e202e8b9814 on hv-cinder-83697 Jul 16 13:00:54.259502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-6db8924f-705f-4211-b7e0-831a0a216b94 req-46d2b87c-cf56-4544-93a5-b748b58541e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159123 Jul 16 13:00:54.260159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 500/1010] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:00:55.025351 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:55.025966 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:55.032158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:55.032604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:55.033524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:55.033938 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:55.174837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:55.183590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0cc201af-6671-4edf-b129-ab2945ac0233 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.161852 Jul 16 13:00:55.184168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 511/1011] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:55 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:56.201517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:56.202223 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:56.208229 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:56.208685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:56.213178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:56.213178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:56.345581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:56.353000 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-85eb8561-f68c-45c4-b532-fa8d524f97af tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1318 microversion: 2.1 time: 0.157018 Jul 16 13:00:56.353595 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 501/1012] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:56 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:00:57.370708 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:00:57.371397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:00:57.373813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:57.378496 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:57.378970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:57.379736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:00:57.380171 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:00:57.384098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=73 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:00:57.510794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:00:57.518257 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cfbc3438-8488-4d63-9c9a-10eeddb53252 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1507 microversion: 2.1 time: 0.151425 Jul 16 13:00:57.518833 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 512/1013] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:00:57 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:21.385470 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c46ebb2c-d692-45ae-a005-246ab096611b", "device": "/dev/sdb"}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:21.387150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:21.389756 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:21.390477 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:21.396115 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:21.399220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:21.399220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:21.399220 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:22.210175 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-36483233-e6c5-4eb2-a10d-fb56326131be tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "POST /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833576 Jul 16 13:01:22.210840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 502/1014] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 13:01:21 2022] POST /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 13:01:22.389327 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1118059455", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "networks": [{"uuid": "eb97c5ac-a393-4c46-84f2-3c9da576b527"}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:22.397641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=5 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:22.442909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] validate_networks() for [('eb97c5ac-a393-4c46-84f2-3c9da576b527', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:01:22.794348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:01:22.794770 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:01:22.795282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:01:22.795687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:01:22.796110 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:01:22.806056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:22.806441 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:22.807222 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:22.807652 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:22.825696 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Getting quotas for project a5927ebc582d49538443e497cc15519d. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:01:22.829566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Getting quotas for user b68e5780b6324fc48b45b38503d2bcb6 and project a5927ebc582d49538443e497cc15519d. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:01:22.840534 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:01:22.842911 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:01:22.973218 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c92880c5-369b-4770-83fb-652ab95ce128 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588129 Jul 16 13:01:22.973860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 513/1015] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:01:22.984741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-496931d1-5eb4-4ef2-88cb-55451b833fdf tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:22.985478 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-496931d1-5eb4-4ef2-88cb-55451b833fdf tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:23.039502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-496931d1-5eb4-4ef2-88cb-55451b833fdf tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:23.046235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-496931d1-5eb4-4ef2-88cb-55451b833fdf tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1214 microversion: 2.1 time: 0.066166 Jul 16 13:01:23.046811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 503/1016] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:22 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:24.064122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:24.068275 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:24.074315 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:24.074759 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:24.075515 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:24.075949 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:24.136955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:24.144561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-fa4f320b-bd66-42f0-bc48-f223cb0b7da3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1218 microversion: 2.1 time: 0.084862 Jul 16 13:01:24.145129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 514/1017] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:24 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:25.161693 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:25.162466 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:25.170378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:25.171186 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:25.172300 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:25.172961 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:25.241310 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:25.263356 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4d9255e2-4a39-40e0-8c3c-b441a68a28a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1274 microversion: 2.1 time: 0.105682 Jul 16 13:01:25.263948 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 504/1018] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:25 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:26.280295 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:26.280905 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:26.287623 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:26.288068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:26.288823 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:26.289282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:26.469111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:26.476538 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ae2f5cfc-c9b2-480f-99a7-4f3519d9eeb4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.200378 Jul 16 13:01:26.486143 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 515/1019] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:26 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:26.845471 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-7c64e19f-aade-46d9-b0aa-e3758a4f3040 req-8daf650a-1dfd-4354-ad6a-180368ebe4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5968e856-28f2-4d48-b04e-ceb4fe27e46e", "tag": "fdb763ec-785f-46fa-b8b2-cb3e1adbcf75"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:26.854258 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-7c64e19f-aade-46d9-b0aa-e3758a4f3040 req-8daf650a-1dfd-4354-ad6a-180368ebe4dd service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:26.861221 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-7c64e19f-aade-46d9-b0aa-e3758a4f3040 req-8daf650a-1dfd-4354-ad6a-180368ebe4dd service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:26.866266 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-7c64e19f-aade-46d9-b0aa-e3758a4f3040 req-8daf650a-1dfd-4354-ad6a-180368ebe4dd service nova] Creating event network-changed:fdb763ec-785f-46fa-b8b2-cb3e1adbcf75 for instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e on hv-cinder-83697 Jul 16 13:01:26.871264 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-7c64e19f-aade-46d9-b0aa-e3758a4f3040 req-8daf650a-1dfd-4354-ad6a-180368ebe4dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029446 Jul 16 13:01:26.871614 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 505/1020] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:01:27.495977 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:27.497558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:27.506792 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:27.507690 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:27.508173 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:27.508670 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:27.643600 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:27.652131 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-604af31b-fa5b-49a7-9895-7d3ead6b7bf4 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.161592 Jul 16 13:01:27.652681 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 516/1021] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:27 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:28.670988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:28.671694 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:28.678812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:28.679261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:28.680020 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:28.680457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:28.811048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:28.818542 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2b0aa815-07fe-4202-9d09-fad0106d19b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.152226 Jul 16 13:01:28.819111 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 506/1022] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:28 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:29.835326 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:29.835974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:29.842418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:29.842868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:29.843620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:29.844056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:29.974370 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:29.981811 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e3ec5360-aaef-42bd-9efd-f0600151b5a8 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.150458 Jul 16 13:01:29.982363 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 517/1023] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:29 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:30.999148 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:30.999762 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:31.007025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:31.007476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:31.008243 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:31.008680 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:31.138448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:31.147124 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1996c993-61ae-48fd-9b97-c3416ad938d3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.151941 Jul 16 13:01:31.147693 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 507/1024] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:30 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:32.164302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:32.164916 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:32.171325 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:32.171775 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:32.172541 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:32.172980 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:32.306200 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:32.314385 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a0a7f95e-108b-43e0-8db4-d025c5bf8761 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.154510 Jul 16 13:01:32.314969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 518/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:32 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:32.442817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-97d1cd13-2678-4cbd-a4e2-c6641a7e65f9 req-d8e6f1a6-a70f-489f-9e5f-56a787422cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5968e856-28f2-4d48-b04e-ceb4fe27e46e", "name": "network-vif-plugged", "status": "completed", "tag": "fdb763ec-785f-46fa-b8b2-cb3e1adbcf75"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:32.451316 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-97d1cd13-2678-4cbd-a4e2-c6641a7e65f9 req-d8e6f1a6-a70f-489f-9e5f-56a787422cf2 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:32.453157 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-97d1cd13-2678-4cbd-a4e2-c6641a7e65f9 req-d8e6f1a6-a70f-489f-9e5f-56a787422cf2 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:32.462957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-97d1cd13-2678-4cbd-a4e2-c6641a7e65f9 req-d8e6f1a6-a70f-489f-9e5f-56a787422cf2 service nova] Creating event network-vif-plugged:fdb763ec-785f-46fa-b8b2-cb3e1adbcf75 for instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e on hv-cinder-83697 Jul 16 13:01:32.467898 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-97d1cd13-2678-4cbd-a4e2-c6641a7e65f9 req-d8e6f1a6-a70f-489f-9e5f-56a787422cf2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029486 Jul 16 13:01:32.468467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 508/1026] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:01:33.330937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:33.331547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:33.333397 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:33.334112 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:33.339457 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:33.340295 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:33.340703 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:33.341168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:33.470447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:33.478453 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ddf24931-abfa-42c9-9bf6-9b53e863f95a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.151322 Jul 16 13:01:33.479030 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 519/1027] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:33 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:34.493239 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:34.497833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:34.499005 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:34.505858 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:34.505858 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:34.506230 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:34.507854 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:34.641573 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:34.649065 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f7da62d5-2aa4-4a0a-8ce9-ca390f67ec29 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.156699 Jul 16 13:01:34.649633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 509/1028] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:34 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:35.666317 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:35.666954 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:35.673344 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:35.673784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:35.674532 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:35.674961 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:35.805936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:35.813414 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7ccfbc7c-320a-4c3f-bd03-02f92aa0c8c7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.151489 Jul 16 13:01:35.813975 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 520/1029] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:35 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:36.830788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:36.831324 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:36.838676 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:36.839130 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:36.839898 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:36.840345 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:36.966986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:36.974442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b0825495-989c-480f-853f-4a8f59ae4f2e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.147660 Jul 16 13:01:36.975064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 510/1030] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:36 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:37.992682 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:37.993470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:37.999832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:38.000281 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:38.001052 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:38.001491 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:38.132358 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:38.139982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-758e75c7-f279-4b78-9fcc-00ce3a389042 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1314 microversion: 2.1 time: 0.151251 Jul 16 13:01:38.140579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 521/1031] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:37 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:39.157411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:39.158026 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:39.164314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:39.165288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:39.166036 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:39.166460 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:39.297308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:39.304927 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6d6c4f7e-eccb-47ef-8878-51b82b9439c5 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1498 microversion: 2.1 time: 0.151474 Jul 16 13:01:39.306174 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 511/1032] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:39 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:43.256764 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:43.257287 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:43.264192 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:43.264633 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:43.265418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:43.265930 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:43.292331 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:01:43.572081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1c16790d-4ac8-4c55-8675-e569115799d2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 204 len: 0 microversion: 2.1 time: 0.318737 Jul 16 13:01:43.572590 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 522/1033] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:01:43 2022] DELETE /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:01:43.580794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:43.581431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:43.588790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:43.589275 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:43.590054 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:43.590500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:43.720433 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:43.728226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b6a69b72-c537-40e6-96ed-581210e93351 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1504 microversion: 2.1 time: 0.151311 Jul 16 13:01:43.728813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 512/1034] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:43 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:44.745868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:44.746562 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:44.752950 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:44.753424 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:44.754226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:44.754602 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:44.882655 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:44.890148 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-072f49f8-638c-4e7d-985e-de7b4d876732 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1504 microversion: 2.1 time: 0.148553 Jul 16 13:01:44.890710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 523/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:44 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:45.907627 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:45.908241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:45.915369 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:45.915914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:45.916848 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:45.917314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:46.044820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:46.052145 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f0bfe76d-f223-414e-87ac-156dfe5e88a2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1504 microversion: 2.1 time: 0.148474 Jul 16 13:01:46.052918 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 513/1036] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:45 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:47.069056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:47.069661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:47.076837 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:47.077313 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:47.078068 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:47.078504 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:47.207813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:47.215225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b1b8d224-0c95-4ac6-ab14-9756c64afb66 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1504 microversion: 2.1 time: 0.150027 Jul 16 13:01:47.215782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 524/1037] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:47 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:48.232700 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:48.233327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:48.239780 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:48.240176 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:48.240930 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:48.241384 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:48.377343 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:48.384771 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-532b85b0-97bc-4777-bc1a-d92e48a3edc3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1504 microversion: 2.1 time: 0.155913 Jul 16 13:01:48.385364 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 514/1038] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:48 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:49.402897 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:49.403515 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:49.410072 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:49.410653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:49.411422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:49.411859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:49.626699 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:49.634961 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9779f60a-347f-477d-82ec-9454e46e5d78 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1504 microversion: 2.1 time: 0.237236 Jul 16 13:01:49.637056 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 525/1039] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:49 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:49.867170 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-4d5d8db3-23da-472e-8232-d16dc3c859d7 req-04925dfa-7ad7-4019-935e-cf0e1468ea3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5968e856-28f2-4d48-b04e-ceb4fe27e46e", "name": "network-vif-deleted", "tag": "fdb763ec-785f-46fa-b8b2-cb3e1adbcf75"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:49.876657 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-4d5d8db3-23da-472e-8232-d16dc3c859d7 req-04925dfa-7ad7-4019-935e-cf0e1468ea3e service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:49.877222 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-4d5d8db3-23da-472e-8232-d16dc3c859d7 req-04925dfa-7ad7-4019-935e-cf0e1468ea3e service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:49.888531 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-4d5d8db3-23da-472e-8232-d16dc3c859d7 req-04925dfa-7ad7-4019-935e-cf0e1468ea3e service nova] Creating event network-vif-deleted:fdb763ec-785f-46fa-b8b2-cb3e1adbcf75 for instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e on hv-cinder-83697 Jul 16 13:01:49.894173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-4d5d8db3-23da-472e-8232-d16dc3c859d7 req-04925dfa-7ad7-4019-935e-cf0e1468ea3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029993 Jul 16 13:01:49.894173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 515/1040] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:01:50.651338 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:50.651955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:50.658352 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:50.658800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:50.659923 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:50.660301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:50.690760 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:50.691211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:50.691653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lazy-loading 'fault' on Instance uuid 5968e856-28f2-4d48-b04e-ceb4fe27e46e {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:01:50.743409 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:50.743409 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cbf9761b-77b7-4106-9329-f79b7e4a5b00 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 200 len: 1304 microversion: 2.1 time: 0.095149 Jul 16 13:01:50.743909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 526/1041] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:50 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:51.761151 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:51.761877 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 5968e856-28f2-4d48-b04e-ceb4fe27e46e] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:51.767990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:51.768443 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:51.769240 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:51.769687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:51.783385 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] HTTP exception thrown: Instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e could not be found. Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Request method failure captured: Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e HTTP/1.1 Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rag0aephYEKWJiSLuEIp0qENFTsMZXLHU1u2Ts8O2DoM9Tw770oO2oVpbLuQ4QuBzOyqMdTB9A-aVloNt90C9gtoODO44yyIs4xDSVKobpWgiEOIN65LS-xkF4R1omn4Xk_nwJmrFAI6DM72SjKpsx2YE9fv_n7GAjBPVZS99tqsEA Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: a5927ebc582d49538443e497cc15519d Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesActionsTest-1406259482 Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 13:01:51.785030 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5927ebc582d49538443e497cc15519d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5927ebc582d49538443e497cc15519d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5927ebc582d49538443e497cc15519d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5927ebc582d49538443e497cc15519d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesActionsTest-1406259482 Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: a5927ebc582d49538443e497cc15519d Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesActionsTest-1406259482 Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesActionsTest-1406259482-project Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: b68e5780b6324fc48b45b38503d2bcb6 Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesActionsTest-1406259482-project Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e could not be found. Jul 16 13:01:51.786798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '5968e856-28f2-4d48-b04e-ceb4fe27e46e'} Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e could not be found. Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:01:51.788008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e could not be found. Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e could not be found. Jul 16 13:01:51.789638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:51.792168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Returning 404 to user: Instance 5968e856-28f2-4d48-b04e-ceb4fe27e46e could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:01:51.792168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9afedd41-1954-4479-b0c2-6b931a8bc91e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e" status: 404 len: 111 microversion: 2.1 time: 0.030648 Jul 16 13:01:51.792168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 516/1042] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:51 2022] GET /compute/v2.1/servers/5968e856-28f2-4d48-b04e-ceb4fe27e46e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:01:51.890269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1564056140", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "networks": [{"uuid": "eb97c5ac-a393-4c46-84f2-3c9da576b527"}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:51.946650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] validate_networks() for [('eb97c5ac-a393-4c46-84f2-3c9da576b527', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:01:52.563168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:01:52.563594 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:01:52.564103 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:01:52.564543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:01:52.564960 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:01:52.567075 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:52.574710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:52.575156 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:52.577146 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:52.577146 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:52.582098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:52.593800 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Getting quotas for project a5927ebc582d49538443e497cc15519d. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:01:52.597732 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Getting quotas for user b68e5780b6324fc48b45b38503d2bcb6 and project a5927ebc582d49538443e497cc15519d. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:01:52.609550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:01:52.611809 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:01:52.733111 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-466688f2-888d-4aaa-a50b-889a1a1fbe5b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846545 Jul 16 13:01:52.733815 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 527/1043] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:01:52.744869 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5dfeb797-b475-4c0a-92ff-333f6d023a9f tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:52.745509 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5dfeb797-b475-4c0a-92ff-333f6d023a9f tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:52.747445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=33 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:52.802681 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5dfeb797-b475-4c0a-92ff-333f6d023a9f tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:52.810420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5dfeb797-b475-4c0a-92ff-333f6d023a9f tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1214 microversion: 2.1 time: 0.070050 Jul 16 13:01:52.810986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 517/1044] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:52 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:52.952042 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:52.952753 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:52.958708 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:52.959158 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:52.959919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:52.960353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:53.044564 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lazy-loading 'services' on Instance uuid dbef503f-9c60-44cf-83e4-2e202e8b9814 {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:01:53.244064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-90223ebd-7c0e-4631-811e-bde6a0dccb36 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814/os-volume_attachments/c46ebb2c-d692-45ae-a005-246ab096611b" status: 202 len: 0 microversion: 2.1 time: 0.297027 Jul 16 13:01:53.244933 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 528/1045] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 13:01:52 2022] DELETE /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814/os-volume_attachments/c46ebb2c-d692-45ae-a005-246ab096611b => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 16 13:01:53.828372 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:53.829025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:53.836887 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:53.838506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:53.838506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:53.838714 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:53.841221 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:01:53.902110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:53.909615 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7de67ad4-4bca-45c2-bfa3-421eec4df99d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1218 microversion: 2.1 time: 0.085402 Jul 16 13:01:53.910202 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 518/1046] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:53 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:54.359776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:54.360362 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:54.367059 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:54.368236 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:54.369106 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:54.369546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:54.394220 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:01:54.623095 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-048353d3-e537-4150-9266-bd362d215455 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 204 len: 0 microversion: 2.1 time: 0.267023 Jul 16 13:01:54.623710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 529/1047] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:01:54 2022] DELETE /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:01:54.631759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:54.633678 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:54.639004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:54.639504 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:54.640257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:54.640686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:54.775169 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:54.782820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3b76bb9c-b9d1-498d-9e19-7d3f8b14b11d tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1513 microversion: 2.1 time: 0.154868 Jul 16 13:01:54.783377 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 519/1048] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:54 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:54.927556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:54.928546 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:54.935227 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:54.935678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:54.936439 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:54.936874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:54.998620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:55.005968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-13fa5c40-0f4b-41d2-a497-30dc8496c81c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1274 microversion: 2.1 time: 0.082712 Jul 16 13:01:55.006523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 530/1049] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:54 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:55.800811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:55.801475 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:55.807889 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:55.808379 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:55.809178 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:55.809616 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:55.947157 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:55.954795 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3829f747-0b1d-49b7-af37-68712d0955e2 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1513 microversion: 2.1 time: 0.157869 Jul 16 13:01:55.959517 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 520/1050] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:55 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:56.022529 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:56.023141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:56.029427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:56.029878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:56.030650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:56.031139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:56.094818 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:56.103348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-84514fd3-402b-49c0-bbfe-fe08a170b85d tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1274 microversion: 2.1 time: 0.084407 Jul 16 13:01:56.103944 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 531/1051] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:56 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:56.973373 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:56.974110 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:56.983363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:56.984156 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:56.985448 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:56.986116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:57.059811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:57.067832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b8ab781a-0199-45d7-a6da-1a509d972b94 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 200 len: 1471 microversion: 2.1 time: 0.099885 Jul 16 13:01:57.068410 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 521/1052] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:56 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 1471 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:01:57.119706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:57.120420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:57.126602 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:57.127117 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:57.127982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:57.128489 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:57.130990 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-07a78b4e-31da-4c70-ad3b-340d5d64ef33 req-5569ce12-9e9d-4b8c-8eef-b2dcd3c41025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbef503f-9c60-44cf-83e4-2e202e8b9814", "name": "network-vif-deleted", "tag": "dc8f5d80-75ce-41db-91d4-fc3a8154fcd9"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:57.142386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-07a78b4e-31da-4c70-ad3b-340d5d64ef33 req-5569ce12-9e9d-4b8c-8eef-b2dcd3c41025 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:57.142830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-07a78b4e-31da-4c70-ad3b-340d5d64ef33 req-5569ce12-9e9d-4b8c-8eef-b2dcd3c41025 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:57.154982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-07a78b4e-31da-4c70-ad3b-340d5d64ef33 req-5569ce12-9e9d-4b8c-8eef-b2dcd3c41025 service nova] Creating event network-vif-deleted:dc8f5d80-75ce-41db-91d4-fc3a8154fcd9 for instance dbef503f-9c60-44cf-83e4-2e202e8b9814 on hv-cinder-83697 Jul 16 13:01:57.160382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-07a78b4e-31da-4c70-ad3b-340d5d64ef33 req-5569ce12-9e9d-4b8c-8eef-b2dcd3c41025 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177912 Jul 16 13:01:57.161558 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 532/1053] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 13:01:57.282825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:57.290360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f9fb4937-3bf4-4798-8d87-b8d7d21fde7e tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.174563 Jul 16 13:01:57.291122 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 522/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:57 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:01:57.449817 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-56fd2815-13d1-4863-a266-355bdd10fb53 req-c24ea918-49f5-4e59-9328-22446766cf2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f52d18-d841-46d8-b7e5-65208e021f1c", "tag": "94a41d1f-92cf-46fb-b9b4-1f4d3832c2e3"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:01:57.457655 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-56fd2815-13d1-4863-a266-355bdd10fb53 req-c24ea918-49f5-4e59-9328-22446766cf2a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:57.458104 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-56fd2815-13d1-4863-a266-355bdd10fb53 req-c24ea918-49f5-4e59-9328-22446766cf2a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:57.469267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-56fd2815-13d1-4863-a266-355bdd10fb53 req-c24ea918-49f5-4e59-9328-22446766cf2a service nova] Creating event network-changed:94a41d1f-92cf-46fb-b9b4-1f4d3832c2e3 for instance 74f52d18-d841-46d8-b7e5-65208e021f1c on hv-cinder-83697 Jul 16 13:01:57.473935 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-56fd2815-13d1-4863-a266-355bdd10fb53 req-c24ea918-49f5-4e59-9328-22446766cf2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029780 Jul 16 13:01:57.474536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 533/1055] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:01:58.085371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:58.086004 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: dbef503f-9c60-44cf-83e4-2e202e8b9814] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:58.092319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:58.092759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:58.093565 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:58.093996 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:58.107789 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] HTTP exception thrown: Instance dbef503f-9c60-44cf-83e4-2e202e8b9814 could not be found. Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Request method failure captured: Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 HTTP/1.1 Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rZ1NrFQAvRKAzXBWjtblpnvg7ggJ7kIOpSIHsUugfo4MISYbaxXKYdl5uh56iu1s7szKZl3h_Gsy4Wmn6_y0YHLkCFYO3oDrZPV6wd3ll5olf4WaRETKY7lkQhUGM-jVmX-bsum6LUKP7Ux6L2kM3EzwQ9TENSKGPTltgV8uTXxxuc Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: ada92e33c07f4be7b2d752550c381dfb Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1684386615 Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 13:01:58.109338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ada92e33c07f4be7b2d752550c381dfb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ada92e33c07f4be7b2d752550c381dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ada92e33c07f4be7b2d752550c381dfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ada92e33c07f4be7b2d752550c381dfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesSnapshotTestJSON-1684386615 Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: ada92e33c07f4be7b2d752550c381dfb Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1684386615 Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesSnapshotTestJSON-1684386615-project Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: c89a6bacbd004d99837d8d092352f18f Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesSnapshotTestJSON-1684386615-project Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance dbef503f-9c60-44cf-83e4-2e202e8b9814 could not be found. Jul 16 13:01:58.111079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': 'dbef503f-9c60-44cf-83e4-2e202e8b9814'} Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbef503f-9c60-44cf-83e4-2e202e8b9814 could not be found. Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:01:58.112050 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbef503f-9c60-44cf-83e4-2e202e8b9814 could not be found. Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbef503f-9c60-44cf-83e4-2e202e8b9814 could not be found. Jul 16 13:01:58.113458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:01:58.114840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Returning 404 to user: Instance dbef503f-9c60-44cf-83e4-2e202e8b9814 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:01:58.114840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-627c22d1-d834-4ed2-a662-eb7725aa013b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814" status: 404 len: 111 microversion: 2.1 time: 0.029191 Jul 16 13:01:58.114840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 523/1056] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:58 2022] GET /compute/v2.1/servers/dbef503f-9c60-44cf-83e4-2e202e8b9814 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:01:58.311048 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:58.311667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:58.317799 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:58.318240 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:58.318986 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:58.319413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:58.454299 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:58.463589 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-c7acb1dc-0465-49be-9d8d-ad4c166577b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.157103 Jul 16 13:01:58.465504 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 534/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:58 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:01:59.480084 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:01:59.480699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:01:59.487201 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:59.487649 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:59.488417 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:01:59.488852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:01:59.623412 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:01:59.630836 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-927a3716-d26e-4e94-ae4e-dd6898e3e5b2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.154846 Jul 16 13:01:59.631476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 524/1058] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:01:59 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:00.647687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:00.655874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:00.655874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:00.655874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:00.656206 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:00.656638 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:00.790007 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:00.797578 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1fcee96c-79e1-43d1-9929-b430e337354c tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.153701 Jul 16 13:02:00.798139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 535/1059] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:00 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:01.815668 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:01.816204 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:01.823366 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:01.823818 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:01.824585 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:01.825021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:01.956128 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:01.963999 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-44b4fd22-831d-4508-8a56-851d3ccd0ecc tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.152323 Jul 16 13:02:01.964594 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 525/1060] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:01 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:02.981549 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:02.982161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:02.984554 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:02.985311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:02.989955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:02.990405 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:02.991162 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:02.991593 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:03.119479 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:03.126832 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-106bdcaf-b1d5-440a-8c7d-b55b49e271b9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.150024 Jul 16 13:02:03.127389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 536/1061] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:02 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:04.143861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:04.144450 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:04.146398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:04.152437 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:04.156661 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:04.156661 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:04.156661 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:04.289614 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:04.297957 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f10b4334-93a9-464a-b92f-159698b899da tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.158185 Jul 16 13:02:04.298524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 526/1062] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:04 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:05.315443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:05.316143 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:05.323860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:05.324311 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:05.325125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:05.325692 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:05.465418 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:05.473114 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6fc6f6f1-df1d-49d5-a44e-d2c154936402 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.161813 Jul 16 13:02:05.473751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 537/1063] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:05 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:06.490808 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:06.491383 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:06.498427 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:06.498875 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:06.499637 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:06.500079 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:06.627378 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:06.635325 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-56c6ed20-5d51-4469-8f9c-6a354e590339 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.147875 Jul 16 13:02:06.635882 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 527/1064] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:06 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:07.652268 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:07.652878 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:07.659437 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:07.659903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:07.660684 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:07.661141 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:07.793588 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:07.800819 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a433e60a-aa19-48a5-8f8c-4bfbea3c00ac tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.153039 Jul 16 13:02:07.801413 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 538/1065] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:07 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:08.817717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:08.818265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:08.824678 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:08.825153 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:08.825905 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:08.826332 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:08.957018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:08.964938 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d714c4d9-0a63-4ecf-8221-657e3f2123a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.151300 Jul 16 13:02:08.965540 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 528/1066] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:08 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:09.982323 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:09.982874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:09.989231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:09.989675 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:09.990424 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:09.990853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:10.120232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:10.127617 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1dbe59ba-2674-40c3-93f4-09b5c342c9f3 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.149803 Jul 16 13:02:10.128205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 539/1067] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:09 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:10.574461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-275106265", "imageRef": "19074ffa-f222-4ffe-8ecf-f787b673ee03", "flavorRef": "452", "networks": [{"uuid": "a0a377a1-84de-453d-b40d-43d4720569f7"}]}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:10.624685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] validate_networks() for [('a0a377a1-84de-453d-b40d-43d4720569f7', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:02:11.023866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:02:11.024294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:02:11.024767 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:02:11.025301 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:02:11.025807 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:02:11.034526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:11.034973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:11.035772 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:11.036215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:11.053334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Getting quotas for project ada92e33c07f4be7b2d752550c381dfb. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:02:11.057788 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Getting quotas for user c89a6bacbd004d99837d8d092352f18f and project ada92e33c07f4be7b2d752550c381dfb. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:02:11.068596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:02:11.070849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19074ffa-f222-4ffe-8ecf-f787b673ee03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:02:11.143737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:11.144378 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:11.151120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:11.151566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:11.159004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:11.159004 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:11.230960 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d4d6e514-27ca-48b5-8454-2bdec10e78fd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660881 Jul 16 13:02:11.231779 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 529/1068] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:02:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:02:11.241453 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-efc7b286-2d6f-4437-8b86-53471d943270 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:11.242343 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-efc7b286-2d6f-4437-8b86-53471d943270 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:11.293943 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:11.297973 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-efc7b286-2d6f-4437-8b86-53471d943270 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:11.301554 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-745ae734-f9b0-4a76-8848-4fcf8f3fbe69 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.161678 Jul 16 13:02:11.302124 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 540/1069] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:11 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:11.305261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-efc7b286-2d6f-4437-8b86-53471d943270 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1218 microversion: 2.1 time: 0.067569 Jul 16 13:02:11.305814 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 530/1070] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:11 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:11.826627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-c83717e7-e986-48a5-957a-f97e39511584 req-bf3f5a8d-7e52-4c6a-a881-811774eb46fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f52d18-d841-46d8-b7e5-65208e021f1c", "name": "network-vif-plugged", "status": "completed", "tag": "94a41d1f-92cf-46fb-b9b4-1f4d3832c2e3"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:11.835250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-c83717e7-e986-48a5-957a-f97e39511584 req-bf3f5a8d-7e52-4c6a-a881-811774eb46fa service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:11.835250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-c83717e7-e986-48a5-957a-f97e39511584 req-bf3f5a8d-7e52-4c6a-a881-811774eb46fa service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:11.846180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-c83717e7-e986-48a5-957a-f97e39511584 req-bf3f5a8d-7e52-4c6a-a881-811774eb46fa service nova] Creating event network-vif-plugged:94a41d1f-92cf-46fb-b9b4-1f4d3832c2e3 for instance 74f52d18-d841-46d8-b7e5-65208e021f1c on hv-cinder-83697 Jul 16 13:02:11.851122 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-c83717e7-e986-48a5-957a-f97e39511584 req-bf3f5a8d-7e52-4c6a-a881-811774eb46fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029096 Jul 16 13:02:11.851687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 541/1071] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:02:12.319193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:12.319802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:12.324247 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:12.324946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:12.326987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:12.327434 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:12.328194 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:12.328737 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:12.331120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:12.331568 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:12.332328 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:12.332766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:12.395937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:12.403555 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7e3eec06-33f8-4ff1-a5ed-3b716a9880e0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1214 microversion: 2.1 time: 0.084566 Jul 16 13:02:12.404118 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 542/1072] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:12 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:12.461156 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:12.468738 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7ab4299a-932a-44e9-9589-75445e635bc9 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.153418 Jul 16 13:02:12.469335 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 531/1073] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:12 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:13.420803 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:13.421554 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:13.428613 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:13.429089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:13.429855 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:13.430293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:13.486069 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:13.486608 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:13.492988 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:13.493464 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:13.494257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:13.494684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:13.498561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:13.506661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-a15e55b0-fdc6-434b-96a9-aed556f16c9e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1270 microversion: 2.1 time: 0.090662 Jul 16 13:02:13.512904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 543/1074] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:13 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:13.630226 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:13.638298 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3867d151-ff37-43d2-9070-c410d168702b tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1314 microversion: 2.1 time: 0.156112 Jul 16 13:02:13.638864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 532/1075] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:13 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:14.524289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:14.524901 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:14.532222 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:14.532663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:14.533536 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:14.533969 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:14.536736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:14.655629 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:14.656247 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:14.662958 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:14.663415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:14.664290 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:14.664739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:14.714168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:14.721528 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e8266b77-c2de-4ce1-b6c2-fca0c927ff52 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.201109 Jul 16 13:02:14.722089 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 544/1076] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:14 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:14.795891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:14.804152 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-29cf718f-7529-4943-9dd8-f2fe7347f5a7 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1497 microversion: 2.1 time: 0.152842 Jul 16 13:02:14.804726 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 533/1077] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:14 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:15.596306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-aad7b567-0d21-46f0-982a-a276a906c326 req-eb381736-4df8-48c6-848b-a993701649a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f5b85d9-e18c-4a70-9daa-e7989f577d88", "tag": "472bbfb7-8363-4015-ae92-04ef34c25619"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:15.612097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-aad7b567-0d21-46f0-982a-a276a906c326 req-eb381736-4df8-48c6-848b-a993701649a4 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.612097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-aad7b567-0d21-46f0-982a-a276a906c326 req-eb381736-4df8-48c6-848b-a993701649a4 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.621140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-aad7b567-0d21-46f0-982a-a276a906c326 req-eb381736-4df8-48c6-848b-a993701649a4 service nova] Creating event network-changed:472bbfb7-8363-4015-ae92-04ef34c25619 for instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 on hv-cinder-83697 Jul 16 13:02:15.626284 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-aad7b567-0d21-46f0-982a-a276a906c326 req-eb381736-4df8-48c6-848b-a993701649a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033787 Jul 16 13:02:15.627230 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 545/1078] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:02:15.660472 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:15.661012 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:15.668327 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.668770 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.669554 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.669983 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.695232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Going to try to terminate instance {{(pid=124652) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:02:15.741436 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:15.742125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:15.748448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.748891 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.751286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.751286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.949011 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-1f9bdeeb-f16b-42a8-8397-790eb0bb4739 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "DELETE /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 204 len: 0 microversion: 2.1 time: 0.292027 Jul 16 13:02:15.949551 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 534/1079] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:02:15 2022] DELETE /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 16 13:02:15.958012 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:15.958728 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:15.966076 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.966581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.967420 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:15.967917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:15.968205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:15.977438 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e85ae06e-a358-401a-8cd8-3481699455e8 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.240095 Jul 16 13:02:15.978246 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 546/1080] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:15 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:15.985055 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:16.104354 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:16.111687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4bd05c4a-53d3-4328-9904-dfa357677e62 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1503 microversion: 2.1 time: 0.157829 Jul 16 13:02:16.112254 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 535/1081] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:15 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:16.997664 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:16.998680 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:17.008530 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:17.009301 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:17.011909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:17.012347 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:17.129072 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:17.129741 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:17.137308 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:17.137764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:17.138545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:17.138981 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:17.225776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:17.234904 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cf697dba-1720-461e-bc06-4850fd39f6e5 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.242688 Jul 16 13:02:17.244889 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 547/1082] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:16 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:17.294674 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:17.302314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-802e9e5c-63e1-4bbd-a010-03daa543af44 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1503 microversion: 2.1 time: 0.177286 Jul 16 13:02:17.303155 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 536/1083] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:17 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:17.997645 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-a3320361-f20c-463b-a930-252700dfaef2 req-53679bb8-20ea-40f0-81a0-3fc1dbb344b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f52d18-d841-46d8-b7e5-65208e021f1c", "name": "network-vif-deleted", "tag": "94a41d1f-92cf-46fb-b9b4-1f4d3832c2e3"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:18.005748 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-a3320361-f20c-463b-a930-252700dfaef2 req-53679bb8-20ea-40f0-81a0-3fc1dbb344b5 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:18.006350 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-a3320361-f20c-463b-a930-252700dfaef2 req-53679bb8-20ea-40f0-81a0-3fc1dbb344b5 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:18.016984 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-a3320361-f20c-463b-a930-252700dfaef2 req-53679bb8-20ea-40f0-81a0-3fc1dbb344b5 service nova] Creating event network-vif-deleted:94a41d1f-92cf-46fb-b9b4-1f4d3832c2e3 for instance 74f52d18-d841-46d8-b7e5-65208e021f1c on hv-cinder-83697 Jul 16 13:02:18.021716 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-a3320361-f20c-463b-a930-252700dfaef2 req-53679bb8-20ea-40f0-81a0-3fc1dbb344b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028838 Jul 16 13:02:18.022293 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 548/1084] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:02:18.251715 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:18.252328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:18.258810 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:18.259258 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:18.260082 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:18.260552 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:18.321015 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:18.321860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:18.328150 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:18.328601 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:18.334193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:18.334193 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:18.393311 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:18.398144 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:18.401802 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5ac0b1be-8cb8-4c9f-bfef-230cae502fba tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.153988 Jul 16 13:02:18.402388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 537/1085] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:18 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:18.406342 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0fa09d46-d067-4ef5-9e28-2a11cdab5716 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1461 microversion: 2.1 time: 0.089486 Jul 16 13:02:18.406898 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 549/1086] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:18 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:19.419149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:19.419875 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:19.422430 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:19.423049 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:19.426342 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:19.426787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:19.427541 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:19.428225 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:19.429604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:19.430052 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:19.430812 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:19.431246 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:19.494282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:19.502605 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-2cef374c-97b9-4ada-aabb-90b648923f19 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1461 microversion: 2.1 time: 0.083946 Jul 16 13:02:19.503172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 550/1087] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:19 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:19.561235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:19.568506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0a40791d-01ec-4c69-857e-aa3b9b95dba0 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.153875 Jul 16 13:02:19.569078 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 538/1088] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:19 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:20.519684 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:20.523105 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:20.526966 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:20.527422 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:20.528276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:20.528714 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:20.561804 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:20.562282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:20.562765 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.objects.instance [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lazy-loading 'fault' on Instance uuid 74f52d18-d841-46d8-b7e5-65208e021f1c {{(pid=124651) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:02:20.585238 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:20.585852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:20.593109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:20.593567 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:20.594360 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:20.594825 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:20.604348 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68e5780b6324fc48b45b38503d2bcb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5927ebc582d49538443e497cc15519d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:20.611754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-585cfa63-1c30-4e28-a751-b18129ce79e2 tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 200 len: 1304 microversion: 2.1 time: 0.096024 Jul 16 13:02:20.612492 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 551/1089] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:20 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:20.801546 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:20.811135 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-76b1fa45-c303-4ca6-8106-d47d8a666a30 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.230084 Jul 16 13:02:20.811633 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 539/1090] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:20 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:02:21.628518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:21.629166 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] [instance: 74f52d18-d841-46d8-b7e5-65208e021f1c] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:21.636538 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:21.637094 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:21.637857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:21.638297 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:21.651784 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] HTTP exception thrown: Instance 74f52d18-d841-46d8-b7e5-65208e021f1c could not be found. Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Request method failure captured: Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c HTTP/1.1 Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rag0aephYEKWJiSLuEIp0qENFTsMZXLHU1u2Ts8O2DoM9Tw770oO2oVpbLuQ4QuBzOyqMdTB9A-aVloNt90C9gtoODO44yyIs4xDSVKobpWgiEOIN65LS-xkF4R1omn4Xk_nwJmrFAI6DM72SjKpsx2YE9fv_n7GAjBPVZS99tqsEA Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: a5927ebc582d49538443e497cc15519d Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-VolumesActionsTest-1406259482 Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 13:02:21.653547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a5927ebc582d49538443e497cc15519d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5927ebc582d49538443e497cc15519d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a5927ebc582d49538443e497cc15519d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a5927ebc582d49538443e497cc15519d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-VolumesActionsTest-1406259482 Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: a5927ebc582d49538443e497cc15519d Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-VolumesActionsTest-1406259482 Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-VolumesActionsTest-1406259482-project Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: b68e5780b6324fc48b45b38503d2bcb6 Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-VolumesActionsTest-1406259482-project Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 74f52d18-d841-46d8-b7e5-65208e021f1c could not be found. Jul 16 13:02:21.655312 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '74f52d18-d841-46d8-b7e5-65208e021f1c'} Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f52d18-d841-46d8-b7e5-65208e021f1c could not be found. Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:02:21.657022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f52d18-d841-46d8-b7e5-65208e021f1c could not be found. Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f52d18-d841-46d8-b7e5-65208e021f1c could not be found. Jul 16 13:02:21.658426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:02:21.659746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] Returning 404 to user: Instance 74f52d18-d841-46d8-b7e5-65208e021f1c could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:02:21.659746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-cbedc1e6-60de-4ff3-bc83-6f2116f2833a tempest-VolumesActionsTest-1406259482 tempest-VolumesActionsTest-1406259482-project] 10.222.0.47 "GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c" status: 404 len: 111 microversion: 2.1 time: 0.030442 Jul 16 13:02:21.659746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 552/1091] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:21 2022] GET /compute/v2.1/servers/74f52d18-d841-46d8-b7e5-65208e021f1c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:02:21.827904 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:21.834758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:21.834758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:21.834758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=8 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:21.836666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:21.837162 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:21.837987 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:21.838461 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:21.880974 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-0d7253f4-c99e-4fe1-88b8-43c686b2055b req-aeb47b07-9755-4fb8-b7f6-ed23e825f0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5b85d9-e18c-4a70-9daa-e7989f577d88", "name": "network-vif-plugged", "status": "completed", "tag": "472bbfb7-8363-4015-ae92-04ef34c25619"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:21.889403 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-0d7253f4-c99e-4fe1-88b8-43c686b2055b req-aeb47b07-9755-4fb8-b7f6-ed23e825f0d3 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:21.889859 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-0d7253f4-c99e-4fe1-88b8-43c686b2055b req-aeb47b07-9755-4fb8-b7f6-ed23e825f0d3 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:21.901208 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-0d7253f4-c99e-4fe1-88b8-43c686b2055b req-aeb47b07-9755-4fb8-b7f6-ed23e825f0d3 service nova] Creating event network-vif-plugged:472bbfb7-8363-4015-ae92-04ef34c25619 for instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 on hv-cinder-83697 Jul 16 13:02:21.906275 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-0d7253f4-c99e-4fe1-88b8-43c686b2055b req-aeb47b07-9755-4fb8-b7f6-ed23e825f0d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029140 Jul 16 13:02:21.906861 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 553/1092] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:02:21.976914 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:21.986510 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f54eff8e-45fc-4613-a1c4-b372fea09e84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.162326 Jul 16 13:02:21.987131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 540/1093] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:21 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:23.004416 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:23.005153 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:23.012190 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:23.012635 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:23.013432 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:23.013873 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:23.141609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:23.148814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-39f10a02-d2cf-479b-a710-cb987a9d8d81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.149004 Jul 16 13:02:23.149408 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 554/1094] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:22 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:24.167215 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:24.167881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:24.170243 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:24.178862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:24.178862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:24.178862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:24.178862 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:24.279687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:02:24.280252 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:02:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:02:24.307271 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:24.314712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9a3dce06-9d88-41f3-ba6b-00d663942d9b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.152834 Jul 16 13:02:24.315280 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 541/1095] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:24 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:25.332283 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:25.332849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:25.335300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:25.340575 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:25.341023 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:25.341813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:25.342250 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:25.473456 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:25.480839 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7bb7dc48-230c-42cf-adab-9d6dc0738c2e tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.152586 Jul 16 13:02:25.481434 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 555/1096] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:25 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:26.498585 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:26.499262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:26.505432 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:26.505892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:26.506658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:26.507149 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:26.636856 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:26.644272 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b8b14ea0-7228-49a0-973a-c6f7bc874b8b tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.150467 Jul 16 13:02:26.644853 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 542/1097] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:26 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:27.662232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:27.662848 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:27.669189 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:27.669642 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:27.670407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:27.670847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:27.795766 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:27.804945 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-77a659b3-9c93-4cd6-9515-c4428a24a861 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1318 microversion: 2.1 time: 0.146315 Jul 16 13:02:27.805984 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 556/1098] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:27 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:28.822073 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:28.822620 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:28.829309 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:28.829754 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:28.830502 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:28.830929 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:28.968648 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:28.976191 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a445696c-8b05-49c8-aef1-a50b6ace3ac6 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1507 microversion: 2.1 time: 0.158136 Jul 16 13:02:28.976757 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 543/1099] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:28 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:28.993302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5f03c65-ae3d-4ead-ac88-506aa04575a3", "device": "/dev/sdb"}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:28.994864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:29.001937 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:29.002382 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:29.003137 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:29.003565 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:29.765447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f9fc559c-7d97-4d10-9ab2-cd6a441ff84c tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "POST /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775858 Jul 16 13:02:29.772595 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 557/1100] 10.222.0.47 () {60 vars in 1322 bytes} [Sat Jul 16 13:02:28 2022] POST /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88/os-volume_attachments => generated 194 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:02:51.897970 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:51.898557 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:51.900798 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=5 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:51.901513 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=51 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:51.906235 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:51.906685 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:51.907456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:51.907892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:51.991421 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lazy-loading 'services' on Instance uuid 0f5b85d9-e18c-4a70-9daa-e7989f577d88 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:02:52.215109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b4ce5f0d-3ce5-4fee-b435-551d4358be84 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88/os-volume_attachments/a5f03c65-ae3d-4ead-ac88-506aa04575a3" status: 202 len: 0 microversion: 2.1 time: 0.321002 Jul 16 13:02:52.216288 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 544/1101] 10.222.0.47 () {58 vars in 1415 bytes} [Sat Jul 16 13:02:51 2022] DELETE /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88/os-volume_attachments/a5f03c65-ae3d-4ead-ac88-506aa04575a3 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 16 13:02:53.335155 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:53.335902 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:53.338571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=5 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:53.339242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:02:53.345084 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:53.345540 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:53.346302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:53.346736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:53.372936 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:02:53.655968 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e0bd3274-4f14-41f8-a885-d557c9d2a265 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 204 len: 0 microversion: 2.1 time: 0.324730 Jul 16 13:02:53.658932 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 558/1102] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:02:53 2022] DELETE /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:02:53.665823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:53.666516 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:53.673906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:53.674598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:53.675375 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:53.675813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:53.806861 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:53.814763 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a7896195-740a-46b0-a921-979972b4ba07 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1513 microversion: 2.1 time: 0.153616 Jul 16 13:02:53.815329 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 545/1103] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:53 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:54.832570 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:54.833309 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:54.839725 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:54.840175 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:54.841132 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:54.841565 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:54.979813 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:54.987518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-bfc48673-2b21-49a2-ad26-ed0a94002f81 tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1513 microversion: 2.1 time: 0.159372 Jul 16 13:02:54.988071 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 559/1104] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:54 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:56.004758 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:56.005333 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:56.011219 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:56.011666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:56.012493 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:56.012921 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:56.194911 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c89a6bacbd004d99837d8d092352f18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada92e33c07f4be7b2d752550c381dfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:02:56.203462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7da8ca68-f9c6-4088-9d54-5ccc49fd3dcd tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 200 len: 1513 microversion: 2.1 time: 0.202659 Jul 16 13:02:56.204044 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 546/1105] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:55 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:02:56.249125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-59505075-0319-48b3-a3c7-d936410a6277 req-ebaeb981-3318-473f-85a8-c1e439165f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f5b85d9-e18c-4a70-9daa-e7989f577d88", "name": "network-vif-deleted", "tag": "472bbfb7-8363-4015-ae92-04ef34c25619"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:02:56.261438 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-59505075-0319-48b3-a3c7-d936410a6277 req-ebaeb981-3318-473f-85a8-c1e439165f9a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:56.261438 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-59505075-0319-48b3-a3c7-d936410a6277 req-ebaeb981-3318-473f-85a8-c1e439165f9a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:56.269726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-59505075-0319-48b3-a3c7-d936410a6277 req-ebaeb981-3318-473f-85a8-c1e439165f9a service nova] Creating event network-vif-deleted:472bbfb7-8363-4015-ae92-04ef34c25619 for instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 on hv-cinder-83697 Jul 16 13:02:56.274691 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-59505075-0319-48b3-a3c7-d936410a6277 req-ebaeb981-3318-473f-85a8-c1e439165f9a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029246 Jul 16 13:02:56.275286 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 560/1106] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:02:57.221664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:02:57.222283 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] [instance: 0f5b85d9-e18c-4a70-9daa-e7989f577d88] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:02:57.228968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:57.229463 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:57.230323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:02:57.230834 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:02:57.244840 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] HTTP exception thrown: Instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 could not be found. Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Request method failure captured: Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 HTTP/1.1 Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rZ1NrFQAvRKAzXBWjtblpnvg7ggJ7kIOpSIHsUugfo4MISYbaxXKYdl5uh56iu1s7szKZl3h_Gsy4Wmn6_y0YHLkCFYO3oDrZPV6wd3ll5olf4WaRETKY7lkQhUGM-jVmX-bsum6LUKP7Ux6L2kM3EzwQ9TENSKGPTltgV8uTXxxuc Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: ada92e33c07f4be7b2d752550c381dfb Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1684386615 Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 13:02:57.247231 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ada92e33c07f4be7b2d752550c381dfb", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ada92e33c07f4be7b2d752550c381dfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ada92e33c07f4be7b2d752550c381dfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ada92e33c07f4be7b2d752550c381dfb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-VolumesSnapshotTestJSON-1684386615 Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: ada92e33c07f4be7b2d752550c381dfb Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1684386615 Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-VolumesSnapshotTestJSON-1684386615-project Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: c89a6bacbd004d99837d8d092352f18f Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-VolumesSnapshotTestJSON-1684386615-project Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 could not be found. Jul 16 13:02:57.248710 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '0f5b85d9-e18c-4a70-9daa-e7989f577d88'} Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 could not be found. Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:02:57.249684 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 could not be found. Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 could not be found. Jul 16 13:02:57.251467 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:02:57.252992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] Returning 404 to user: Instance 0f5b85d9-e18c-4a70-9daa-e7989f577d88 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:02:57.252992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-be94564c-0060-43b8-8467-c7d5481b27df tempest-VolumesSnapshotTestJSON-1684386615 tempest-VolumesSnapshotTestJSON-1684386615-project] 10.222.0.47 "GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jul 16 13:02:57.252992 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 547/1107] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:02:57 2022] GET /compute/v2.1/servers/0f5b85d9-e18c-4a70-9daa-e7989f577d88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:03:55.975543 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:03:55.976402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:03:56.151389 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4c0351ab-ff3a-43d1-9d75-92921033e246 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Action: 'create', calling method: .version_select at 0x7f6cf8c67ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1546483731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8CBkFN244NWpFBPUjUdPqkqWB4bybNxUCkvV9HafJdBsS9Kyz1xuU3QsQqmb8OimBaGAjvMjq5PtUhP5ewWcpScsx9o3wZFRvv8Lupf+LBfpOdsMt6Qb+Fy5tLftTUMg=="}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:03:56.165531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-4c0351ab-ff3a-43d1-9d75-92921033e246 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for project 57b0103008c445a5b4b980992a61f4c8. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:03:56.169291 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-4c0351ab-ff3a-43d1-9d75-92921033e246 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for user f9dc944192d24af0b1e2f64b7e071a3b and project 57b0103008c445a5b4b980992a61f4c8. Resources: {'key_pairs'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:03:56.278650 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4c0351ab-ff3a-43d1-9d75-92921033e246 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.304973 Jul 16 13:03:56.279246 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 561/1108] 10.222.0.47 () {60 vars in 1158 bytes} [Sat Jul 16 13:03:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:04:09.197713 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:04:09.198373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:04:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:04:25.006303 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=8 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:25.007053 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:25.010976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1263054114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546483731", "security_groups": [{"name": "tempest-secgroup-smoke-112315111"}], "block_device_mapping_v2": [{"uuid": "9911a490-e47b-41e7-b764-1f2e75fb6485", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "725fc83c-1286-47cb-8665-460f3da788e0"}]}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:04:25.279885 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] validate_networks() for [('725fc83c-1286-47cb-8665-460f3da788e0', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:04:25.643519 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:04:25.643947 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:04:25.644424 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:04:25.644832 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:04:25.645287 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:04:25.654009 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:25.654457 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:25.655256 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:25.655690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:25.672884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for project 57b0103008c445a5b4b980992a61f4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:04:25.677064 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for user f9dc944192d24af0b1e2f64b7e071a3b and project 57b0103008c445a5b4b980992a61f4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:04:25.733500 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:04:25.735718 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9911a490-e47b-41e7-b764-1f2e75fb6485',volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:04:26.107402 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d9a8fa2d-d933-4709-8c86-a3d8f4b521c9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.102982 Jul 16 13:04:26.108559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 548/1109] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:04:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:04:26.115694 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=4 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:26.116449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:26.120353 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-75f57766-0069-480c-92f9-06fc20416fda tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:26.121139 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-75f57766-0069-480c-92f9-06fc20416fda tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:26.298778 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-75f57766-0069-480c-92f9-06fc20416fda tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:26.307125 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-75f57766-0069-480c-92f9-06fc20416fda tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1095 microversion: 2.1 time: 0.192659 Jul 16 13:04:26.307696 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 562/1110] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:26 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1095 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:27.323726 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:27.324388 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:27.332560 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:27.337870 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:27.337870 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:27.337870 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:27.395686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:27.403018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f2896103-6425-42e4-8c9a-5e16263405f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1145 microversion: 2.1 time: 0.083159 Jul 16 13:04:27.403572 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 549/1111] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:27 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:28.419879 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:28.420508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:28.427678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:28.428163 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:28.429064 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:28.429523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:28.502282 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:28.510203 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f76f3bd0-d4ef-4545-9c76-8b99eb6ffe21 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1211 microversion: 2.1 time: 0.094252 Jul 16 13:04:28.510991 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 563/1112] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:28 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:29.527934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:29.529173 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:29.536297 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:29.536747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:29.537859 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:29.538302 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:29.671601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:29.680061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-7f827c3d-8367-4a43-b517-e4c6d3dfbaa4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.156163 Jul 16 13:04:29.690120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 550/1113] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:29 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:30.012796 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-36c45d43-2127-4421-99a4-6f3c9b95c438 req-f3c2a34b-5496-419b-a1e3-36ab53391882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a3e0470-ac23-406d-a795-edd806fcbd05", "tag": "10c5dca5-9ded-4042-b44a-39e307136d47"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:04:30.025400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-36c45d43-2127-4421-99a4-6f3c9b95c438 req-f3c2a34b-5496-419b-a1e3-36ab53391882 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:30.025400 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-36c45d43-2127-4421-99a4-6f3c9b95c438 req-f3c2a34b-5496-419b-a1e3-36ab53391882 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:30.038561 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-36c45d43-2127-4421-99a4-6f3c9b95c438 req-f3c2a34b-5496-419b-a1e3-36ab53391882 service nova] Creating event network-changed:10c5dca5-9ded-4042-b44a-39e307136d47 for instance 2a3e0470-ac23-406d-a795-edd806fcbd05 on hv-cinder-83697 Jul 16 13:04:30.044387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-36c45d43-2127-4421-99a4-6f3c9b95c438 req-f3c2a34b-5496-419b-a1e3-36ab53391882 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035118 Jul 16 13:04:30.045306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 564/1114] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:04:30.697536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:30.698130 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:30.704874 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:30.710614 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:30.710614 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:30.710614 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:30.841787 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:30.849756 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cf4ebc4c-720e-4299-bfd8-fd36ddd9c359 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.156300 Jul 16 13:04:30.850314 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 551/1115] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:30 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:31.867805 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:31.868524 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:31.875346 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:31.876428 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:31.877303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:31.877736 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:32.011386 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:32.019370 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4173bd0b-52b3-4e55-9e50-252134f7ed58 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.155843 Jul 16 13:04:32.019927 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 565/1116] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:31 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:33.036816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:33.037511 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:33.043856 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:33.044305 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:33.045093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:33.045536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:33.176257 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:33.183706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-434f747b-5a5c-4366-91c6-702d3dc7f0dc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.150999 Jul 16 13:04:33.184265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 552/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:33 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:34.200853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:34.201508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:34.208616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:34.209097 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:34.209864 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:34.210303 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:34.342007 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:34.349622 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-da1c6049-217d-4a96-beaf-e9c5c9d5c45f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.152615 Jul 16 13:04:34.350172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 566/1118] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:34 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:35.366260 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:35.366876 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:35.373291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:35.373746 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:35.374512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:35.374944 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:35.502545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:35.509954 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-0ad94222-91ea-437d-b323-f0f434de0dfc tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.147590 Jul 16 13:04:35.510514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 553/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:35 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:36.527696 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:36.528211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:36.530655 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:36.536127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:36.536566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:36.537339 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:36.537770 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:36.671638 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:36.679994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-4bd69edf-cf73-47ed-8e29-8880eb55a320 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.156230 Jul 16 13:04:36.680550 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 567/1120] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:36 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:37.696736 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:37.697384 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:37.699270 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:37.699951 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=6 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:04:37.705424 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:37.705881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:37.706631 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:37.707070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:37.840241 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:37.848129 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-45881f36-d4d3-4ba3-8adb-feb0a04a4daf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.155289 Jul 16 13:04:37.848693 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 554/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:37 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:38.864924 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:38.865830 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:38.873262 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:38.873712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:38.874470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:38.874903 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:39.003232 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:39.010601 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-f37cac13-c27c-4d3f-91b9-2aa61fb61bc3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.149599 Jul 16 13:04:39.011160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 568/1122] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:38 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:40.027291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:40.027897 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:40.034968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:40.035412 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:40.036164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:40.036597 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:40.167200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:40.174692 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-3038d513-8768-417c-aa2f-c34b7efc25ca tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.151263 Jul 16 13:04:40.175545 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 555/1123] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:40 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:41.191870 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:41.192480 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:41.198978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:41.199415 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:41.200162 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:41.200591 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:41.340693 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:41.349055 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-d709a88d-3f8d-4059-ad17-972d266fe8c1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.161180 Jul 16 13:04:41.349687 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 569/1124] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:41 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:42.366447 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:42.367057 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:42.373590 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:42.374039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:42.374801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:42.375901 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:42.507823 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:42.515430 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-b51d7faf-af35-429c-a24a-09b937e68a6f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.152885 Jul 16 13:04:42.516274 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 556/1125] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:42 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:42.939370 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-c3434416-779a-4ba3-b584-c112439e351c req-e1e7b277-8703-4e99-a69f-10e553ab2ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a3e0470-ac23-406d-a795-edd806fcbd05", "name": "network-vif-plugged", "status": "completed", "tag": "10c5dca5-9ded-4042-b44a-39e307136d47"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:04:42.947788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-c3434416-779a-4ba3-b584-c112439e351c req-e1e7b277-8703-4e99-a69f-10e553ab2ecd service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:42.948374 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-c3434416-779a-4ba3-b584-c112439e351c req-e1e7b277-8703-4e99-a69f-10e553ab2ecd service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:42.959671 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-c3434416-779a-4ba3-b584-c112439e351c req-e1e7b277-8703-4e99-a69f-10e553ab2ecd service nova] Creating event network-vif-plugged:10c5dca5-9ded-4042-b44a-39e307136d47 for instance 2a3e0470-ac23-406d-a795-edd806fcbd05 on hv-cinder-83697 Jul 16 13:04:42.964794 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-c3434416-779a-4ba3-b584-c112439e351c req-e1e7b277-8703-4e99-a69f-10e553ab2ecd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029211 Jul 16 13:04:42.965449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 570/1126] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:04:43.531675 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:43.532278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:43.538666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:43.539107 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:43.539849 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:43.540284 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:43.672366 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:43.680008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4d085faf-8728-49f7-8cb5-8a73dd421d83 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.152247 Jul 16 13:04:43.680567 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 557/1127] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:43 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:44.698318 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:44.699053 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:44.705976 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:44.706430 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:44.707195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:44.707634 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:44.839622 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:44.847273 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5d7e3533-2dd4-4cca-a4cb-ec97eb3c44f0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1266 microversion: 2.1 time: 0.153657 Jul 16 13:04:44.847853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 571/1128] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:44 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:45.863821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:45.864445 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:45.870806 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:45.871244 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:45.871994 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:45.872425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:46.003729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:46.011372 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4bce2788-11c5-4a69-8659-c32c22bbc4a4 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1452 microversion: 2.1 time: 0.151496 Jul 16 13:04:46.011943 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 558/1129] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:45 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:46.027857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:04:46.028472 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:04:46.035627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:46.036075 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:46.036844 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:46.037307 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:46.174210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:04:46.182532 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b0a9575c-6adc-445d-988e-6283bf9c6b77 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1452 microversion: 2.1 time: 0.158483 Jul 16 13:04:46.183096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 572/1130] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:04:46 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:04:48.344776 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-73c9a494-2492-43ae-b358-b7ebb7881366 req-3cbcd371-132c-46d2-b7dc-7e16e01d2fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a3e0470-ac23-406d-a795-edd806fcbd05", "tag": "10c5dca5-9ded-4042-b44a-39e307136d47"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:04:48.353294 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-73c9a494-2492-43ae-b358-b7ebb7881366 req-3cbcd371-132c-46d2-b7dc-7e16e01d2fa9 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:04:48.353742 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-73c9a494-2492-43ae-b358-b7ebb7881366 req-3cbcd371-132c-46d2-b7dc-7e16e01d2fa9 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:04:48.365092 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-73c9a494-2492-43ae-b358-b7ebb7881366 req-3cbcd371-132c-46d2-b7dc-7e16e01d2fa9 service nova] Creating event network-changed:10c5dca5-9ded-4042-b44a-39e307136d47 for instance 2a3e0470-ac23-406d-a795-edd806fcbd05 on hv-cinder-83697 Jul 16 13:04:48.370097 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-73c9a494-2492-43ae-b358-b7ebb7881366 req-3cbcd371-132c-46d2-b7dc-7e16e01d2fa9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029012 Jul 16 13:04:48.370679 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 559/1131] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:05:39.800331 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:05:39.801144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:05:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:07:02.311663 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f07ec4c9-4aa8-4404-9cd4-0875f70e0ff7] AMQP server on 10.222.0.47:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 16 13:07:02.312489 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=24 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:02.313260 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=52 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:02.317815 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:02.324172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:02.324172 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:02.324502 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:02.325300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:02.325737 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:02.350018 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:07:02.581866 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-0ebcd80c-20c6-435a-9e0a-86e9e0895633 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 204 len: 0 microversion: 2.1 time: 0.271837 Jul 16 13:07:02.582573 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 573/1132] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:07:02 2022] DELETE /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:07:02.588873 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR oslo.messaging._drivers.impl_rabbit [-] [190d7c1d-b3b7-4979-ba06-71f9fe0d998a] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 13:07:02.589790 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:02.590371 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=64 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:02.594726 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:02.595422 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:02.602248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:02.602687 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:02.603569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:02.604002 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:02.741826 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:02.749218 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6145d2f6-41f6-47f5-a1f6-08cb41289824 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1576 microversion: 2.1 time: 0.162150 Jul 16 13:07:02.749781 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 560/1133] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:02 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:03.767210 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:03.767909 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:03.776754 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:03.777271 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:03.778039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:03.778475 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:03.784603 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] [f07ec4c9-4aa8-4404-9cd4-0875f70e0ff7] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54380. Jul 16 13:07:03.913984 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:03.921557 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ac076a73-1804-4ecd-be14-aa184ed21239 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1576 microversion: 2.1 time: 0.158727 Jul 16 13:07:03.922369 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 574/1134] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:03 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:04.942974 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:04.943596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:04.957018 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] [190d7c1d-b3b7-4979-ba06-71f9fe0d998a] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54390. Jul 16 13:07:04.962351 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:04.962811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:04.963599 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:04.964039 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:05.046805 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:05.056863 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-367926f2-cbee-4948-9ff9-f39f84b8a5e0 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1509 microversion: 2.1 time: 0.119031 Jul 16 13:07:05.057459 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 561/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:04 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1509 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:05.262659 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-d2eaab92-e071-457f-b430-3a85e6fbf953 req-8d610ca0-f8c8-46f2-b74d-d56eb7103751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a3e0470-ac23-406d-a795-edd806fcbd05", "name": "network-vif-deleted", "tag": "10c5dca5-9ded-4042-b44a-39e307136d47"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:07:05.276340 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-d2eaab92-e071-457f-b430-3a85e6fbf953 req-8d610ca0-f8c8-46f2-b74d-d56eb7103751 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:05.277075 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-d2eaab92-e071-457f-b430-3a85e6fbf953 req-8d610ca0-f8c8-46f2-b74d-d56eb7103751 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:05.289528 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-d2eaab92-e071-457f-b430-3a85e6fbf953 req-8d610ca0-f8c8-46f2-b74d-d56eb7103751 service nova] Creating event network-vif-deleted:10c5dca5-9ded-4042-b44a-39e307136d47 for instance 2a3e0470-ac23-406d-a795-edd806fcbd05 on hv-cinder-83697 Jul 16 13:07:05.304408 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-d2eaab92-e071-457f-b430-3a85e6fbf953 req-8d610ca0-f8c8-46f2-b74d-d56eb7103751 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140592 Jul 16 13:07:05.304408 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 575/1136] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:07:06.075024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:06.075628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:06.082232 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:06.082674 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:06.083433 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:06.083926 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:06.115696 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:06.116144 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:06.116591 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lazy-loading 'fault' on Instance uuid 2a3e0470-ac23-406d-a795-edd806fcbd05 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:07:06.160766 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:06.168412 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6231f90b-798b-4e94-943e-b47a92869b6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 200 len: 1231 microversion: 2.1 time: 0.097469 Jul 16 13:07:06.168977 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 562/1137] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:06 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:07.187672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:07.188367 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:07.195140 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:07.195582 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:07.196333 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:07.196760 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:07.210184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] HTTP exception thrown: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Request method failure captured: Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 HTTP/1.1 Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rc14jXwsxSwUYtRBipf0cpgYtDuA7sqq52SFQQyPR_0Cbve5tAN4KCNZVZbmb5yrDkOkInsTgXsCxh1T2aNBIszMmKqiJfF7_gJSi823mWYDu5Czqh1y_S2mnv8RDRySTCoQcdLSNmgUGFovXWQzBTnYoCjPQx43X_3_efSRctEYrA Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 13:07:07.211776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b0103008c445a5b4b980992a61f4c8", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f9dc944192d24af0b1e2f64b7e071a3b Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:07:07.213609 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '2a3e0470-ac23-406d-a795-edd806fcbd05'} Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:07:07.214651 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:07:07.216334 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:07:07.217899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Returning 404 to user: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:07:07.217899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7669b547-c379-4300-b787-fe8e154b3526 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 404 len: 111 microversion: 2.1 time: 0.030216 Jul 16 13:07:07.217899 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 576/1138] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:07 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:07:07.257912 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-978550554", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546483731", "security_groups": [{"name": "tempest-secgroup-smoke-112315111"}], "block_device_mapping_v2": [{"uuid": "9911a490-e47b-41e7-b764-1f2e75fb6485", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "725fc83c-1286-47cb-8665-460f3da788e0"}]}} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:07:07.370966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.network.neutron [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] validate_networks() for [('725fc83c-1286-47cb-8665-460f3da788e0', None, None, None, None, None)] {{(pid=124652) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:07:07.976278 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Flavor limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:07:07.976706 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Image limits 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:07:07.977217 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Flavor pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:07:07.977631 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Image pref 0:0:0 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:07:07.978043 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.virt.hardware [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124652) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:07:07.986759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:07.987206 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:07.988008 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:07.988449 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:08.005891 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for project 57b0103008c445a5b4b980992a61f4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:07:08.009816 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.quota [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for user f9dc944192d24af0b1e2f64b7e071a3b and project 57b0103008c445a5b4b980992a61f4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=124652) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:07:08.067709 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Going to run 1 instances... {{(pid=124652) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:07:08.069817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9911a490-e47b-41e7-b764-1f2e75fb6485',volume_size=None,volume_type=None)] {{(pid=124652) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:07:08.428061 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR oslo.messaging._drivers.impl_rabbit [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [07dfb9cb-b8ff-4b83-b027-b071d67c0a94] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 13:07:09.435099 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [07dfb9cb-b8ff-4b83-b027-b071d67c0a94] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54418. Jul 16 13:07:09.438867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-823249cc-c752-4b5d-8e82-8b8849aed05d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.184919 Jul 16 13:07:09.439510 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 563/1139] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:07:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:07:09.450084 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-44280d29-3aab-47f3-a822-96dda6b7250f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:09.450689 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-44280d29-3aab-47f3-a822-96dda6b7250f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:09.504955 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-44280d29-3aab-47f3-a822-96dda6b7250f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:09.511481 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-44280d29-3aab-47f3-a822-96dda6b7250f tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1094 microversion: 2.1 time: 0.065359 Jul 16 13:07:09.512038 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 577/1140] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:09 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:10.529363 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f5e907ea-ec9f-492b-af13-79b93b4cad65 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:10.530048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f5e907ea-ec9f-492b-af13-79b93b4cad65 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:10.585920 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f5e907ea-ec9f-492b-af13-79b93b4cad65 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:10.589707 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f5e907ea-ec9f-492b-af13-79b93b4cad65 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1094 microversion: 2.1 time: 0.064750 Jul 16 13:07:10.590265 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 564/1141] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:10 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:11.606641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-14e6945b-e9a3-40be-8434-167d59d9813a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:11.607289 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-14e6945b-e9a3-40be-8434-167d59d9813a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:11.664788 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-14e6945b-e9a3-40be-8434-167d59d9813a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:11.671421 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-14e6945b-e9a3-40be-8434-167d59d9813a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1094 microversion: 2.1 time: 0.068979 Jul 16 13:07:11.672234 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 578/1142] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:11 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:12.689088 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-2bfb7fa1-bb06-4643-ba50-731dda234978 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:12.690431 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-2bfb7fa1-bb06-4643-ba50-731dda234978 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:12.746747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-2bfb7fa1-bb06-4643-ba50-731dda234978 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:12.753458 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-2bfb7fa1-bb06-4643-ba50-731dda234978 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1094 microversion: 2.1 time: 0.068238 Jul 16 13:07:12.755182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 565/1143] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:12 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:13.770531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:13.771078 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:13.777574 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:13.778017 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:13.778765 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:13.779195 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:13.839515 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:13.846841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-11d56717-4355-4dd7-8742-e13231aed37c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1144 microversion: 2.1 time: 0.080360 Jul 16 13:07:13.847888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 579/1144] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:13 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:14.864705 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:14.865455 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:14.871917 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:14.872352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:14.873153 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:14.873590 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:14.935526 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:14.945390 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bed7e157-6aee-4ff9-b1f8-8b44476dd4ee tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1136 microversion: 2.1 time: 0.083292 Jul 16 13:07:14.945986 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 566/1145] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:14 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:15.962627 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:15.963544 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:15.969982 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:15.970428 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:15.971184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:15.971616 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:16.033641 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:16.041322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3fbb3412-f5d2-47db-802f-325883482431 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1210 microversion: 2.1 time: 0.082583 Jul 16 13:07:16.041884 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 580/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:15 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:17.064261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:17.064884 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:17.065621 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-3de1f730-b260-4f63-8029-8de1fea49e3f req-b1c7c5d6-52c8-420d-9c3c-f728381f1eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b27ab84-ec2b-4c77-a805-b74bfc345c26", "tag": "f996831a-4275-4280-8411-12aa52a537cf"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:07:17.077604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3de1f730-b260-4f63-8029-8de1fea49e3f req-b1c7c5d6-52c8-420d-9c3c-f728381f1eb8 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:17.077604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-3de1f730-b260-4f63-8029-8de1fea49e3f req-b1c7c5d6-52c8-420d-9c3c-f728381f1eb8 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:17.083821 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:17.084277 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:17.085093 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:17.085539 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:17.101352 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-3de1f730-b260-4f63-8029-8de1fea49e3f req-b1c7c5d6-52c8-420d-9c3c-f728381f1eb8 service nova] Creating event network-changed:f996831a-4275-4280-8411-12aa52a537cf for instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 on hv-cinder-83697 Jul 16 13:07:17.107932 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-3de1f730-b260-4f63-8029-8de1fea49e3f req-b1c7c5d6-52c8-420d-9c3c-f728381f1eb8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050054 Jul 16 13:07:17.108796 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 581/1147] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:07:17.317933 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:17.325335 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c824d50f-7121-4385-9a95-960c5cbe25c5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.270350 Jul 16 13:07:17.325899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 567/1148] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:17 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:18.344096 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:18.344787 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:18.351020 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:18.351470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:18.352226 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:18.352661 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:18.484876 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:18.492426 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ec6aea9c-e111-465e-bdf3-64b44fb15106 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.153026 Jul 16 13:07:18.492989 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 582/1149] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:18 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:19.509116 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:19.509632 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:19.511444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:19.516717 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:19.517200 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:19.517964 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:19.518398 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:19.650393 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:19.657846 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-4e70f80b-cd98-4548-be4f-88adbb563995 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.152725 Jul 16 13:07:19.658406 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 568/1150] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:19 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:20.676021 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:20.676644 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:20.683000 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:20.683443 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:20.684187 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:20.684620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:20.812610 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:20.820430 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-76b86f66-86c8-4a70-9f20-a274328bbfd5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.148914 Jul 16 13:07:20.820993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 583/1151] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:20 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:21.837205 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:21.837811 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:21.844293 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:21.844732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:21.845514 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:21.845948 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:21.977794 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:21.985160 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-d393b3b3-db2d-4084-b11d-e74ad6c750d5 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.151890 Jul 16 13:07:21.985753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 569/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:21 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:23.002677 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:23.003290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:23.005941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=4 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:23.011373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:23.011807 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:23.017161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:23.017161 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:23.147919 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:23.155582 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-66ac210c-d806-41d2-874c-f3a7224ccc0a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.156771 Jul 16 13:07:23.156155 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 584/1153] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:22 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:24.172906 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:24.173473 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:24.175261 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=10 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:24.181724 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:24.184584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:24.184584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:24.184584 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:24.315164 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:24.323326 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-c5e3908f-8f5d-4d62-9566-1853534a07bf tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.154801 Jul 16 13:07:24.323934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 570/1154] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:24 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:25.340699 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:25.341373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:25.347857 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:25.348310 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:25.349094 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:25.350129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:25.480672 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:25.488117 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-9a8d4ecf-24c5-4966-8f1f-5bc0030d0e1a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.151312 Jul 16 13:07:25.488709 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 585/1155] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:25 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:26.505350 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:26.506062 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:26.512730 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:26.513212 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:26.513975 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:26.514476 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:26.648881 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:26.656325 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-145c4a8f-ed88-4d92-b44d-f1a20e1dc105 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.154906 Jul 16 13:07:26.656866 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 571/1156] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:26 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:27.673762 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:27.674433 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:27.681523 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:27.681978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:27.682745 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:27.683180 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:27.817340 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:27.825462 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-01885d81-5245-44c5-bd59-498a18cae852 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.155744 Jul 16 13:07:27.826032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 586/1157] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:27 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:28.842533 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:28.843167 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:28.849976 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:28.850415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:28.851166 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:28.851596 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:28.980086 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:28.987373 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9202870a-8767-46e9-a694-3fa42729a194 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.148727 Jul 16 13:07:28.987934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 572/1158] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:28 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:29.205656 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:07:29.206160 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:07:29.712519 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-07f102d6-4c23-4b20-a66d-b15ffe3f5d19 req-2476b621-86dd-488e-a83c-ea0a12af5190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b27ab84-ec2b-4c77-a805-b74bfc345c26", "name": "network-vif-plugged", "status": "completed", "tag": "f996831a-4275-4280-8411-12aa52a537cf"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:07:29.720611 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-07f102d6-4c23-4b20-a66d-b15ffe3f5d19 req-2476b621-86dd-488e-a83c-ea0a12af5190 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:29.721073 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-07f102d6-4c23-4b20-a66d-b15ffe3f5d19 req-2476b621-86dd-488e-a83c-ea0a12af5190 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:29.732967 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-07f102d6-4c23-4b20-a66d-b15ffe3f5d19 req-2476b621-86dd-488e-a83c-ea0a12af5190 service nova] Creating event network-vif-plugged:f996831a-4275-4280-8411-12aa52a537cf for instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 on hv-cinder-83697 Jul 16 13:07:29.738194 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-07f102d6-4c23-4b20-a66d-b15ffe3f5d19 req-2476b621-86dd-488e-a83c-ea0a12af5190 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085115 Jul 16 13:07:29.738963 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 587/1159] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:07:30.004769 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:30.005386 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:30.012040 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:30.012487 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:30.013282 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:30.013732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:30.202536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:30.210839 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-dbd3375b-c113-488b-84fb-706a403c91b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.209956 Jul 16 13:07:30.211412 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 573/1160] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:29 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:31.227847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:31.228545 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:31.235306 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:31.235758 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:31.236508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:31.236939 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:31.372797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:31.380620 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-da71dcb6-8cc3-42e3-b4c1-535ab7663d97 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1265 microversion: 2.1 time: 0.157266 Jul 16 13:07:31.381394 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 588/1161] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:31 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:32.398013 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:32.398625 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:32.405028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:32.405506 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:32.406263 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:32.406699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:32.534070 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:32.541456 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a6e5d545-6cb9-4b7c-8ac2-a7ccec7a63ff tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1451 microversion: 2.1 time: 0.147861 Jul 16 13:07:32.542024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 574/1162] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:32 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:32.557567 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:07:32.558205 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:07:32.560531 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:32.565493 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:32.565940 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:32.566698 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:32.567127 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:32.570407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:07:32.700488 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:07:32.707888 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-3dd9ab75-396d-42e2-afb4-078cd71c18fb tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1451 microversion: 2.1 time: 0.154120 Jul 16 13:07:32.708449 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 589/1163] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:07:32 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:07:34.882666 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b27ab84-ec2b-4c77-a805-b74bfc345c26", "tag": "f996831a-4275-4280-8411-12aa52a537cf"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:07:34.890696 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:07:34.891139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:07:34.902753 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] Creating event network-changed:f996831a-4275-4280-8411-12aa52a537cf for instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 on hv-cinder-83697 Jul 16 13:07:34.906322 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR oslo.messaging._drivers.impl_rabbit [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] [c7d59b01-97e9-4702-8650-4e28de50b898] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 13:07:35.913617 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] [c7d59b01-97e9-4702-8650-4e28de50b898] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54510. Jul 16 13:07:35.916773 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-3708b83c-a7fc-4ba4-8209-19317461e39a req-5e765be1-a616-497f-aa2d-829e0b1368fe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.098668 Jul 16 13:07:35.917444 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 575/1164] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 13:08:59.810264 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:08:59.810991 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:09:04.291993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:09:04.292498 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:09:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:09:35.361300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1405932782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1546483731", "security_groups": [{"name": "tempest-secgroup-smoke-112315111"}], "block_device_mapping_v2": [{"uuid": "aa566e71-bef4-4df4-a445-a0db320ab43d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "725fc83c-1286-47cb-8665-460f3da788e0"}]}} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:09:35.532847 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.network.neutron [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] validate_networks() for [('725fc83c-1286-47cb-8665-460f3da788e0', None, None, None, None, None)] {{(pid=124651) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 16 13:09:35.942040 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Flavor limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 16 13:09:35.942465 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Image limits 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 16 13:09:35.942994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Flavor pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 16 13:09:35.943402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Image pref 0:0:0 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 16 13:09:35.943840 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.virt.hardware [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124651) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 16 13:09:35.952569 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:35.953021 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:35.954373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:35.954814 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:35.972808 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for project 57b0103008c445a5b4b980992a61f4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 16 13:09:35.976653 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.quota [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Getting quotas for user f9dc944192d24af0b1e2f64b7e071a3b and project 57b0103008c445a5b4b980992a61f4c8. Resources: {'instances', 'cores', 'ram'} {{(pid=124651) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 16 13:09:36.031746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Going to run 1 instances... {{(pid=124651) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 16 13:09:36.034537 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa566e71-bef4-4df4-a445-a0db320ab43d',volume_size=None,volume_type=None)] {{(pid=124651) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 16 13:09:36.408242 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e2cbee3a-e8df-4cae-9111-121f7737e653 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.053047 Jul 16 13:09:36.409202 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 590/1165] 10.222.0.47 () {60 vars in 1146 bytes} [Sat Jul 16 13:09:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 16 13:09:36.417395 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:09:36.418662 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=78 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:09:36.423077 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-bfc2a9e9-a35c-40c3-b7f4-a111457fbc75 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:36.424048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-bfc2a9e9-a35c-40c3-b7f4-a111457fbc75 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:36.533177 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-bfc2a9e9-a35c-40c3-b7f4-a111457fbc75 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:36.539860 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-bfc2a9e9-a35c-40c3-b7f4-a111457fbc75 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1095 microversion: 2.1 time: 0.124595 Jul 16 13:09:36.540496 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 576/1166] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:36 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:37.557920 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:37.558538 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:37.565514 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:37.565964 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:37.566729 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:37.567168 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:37.630583 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:37.638174 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-7c4730a0-0f56-47ce-8cfd-5e8b5e7ec2f1 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1137 microversion: 2.1 time: 0.084624 Jul 16 13:09:37.638734 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 591/1167] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:37 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:38.655941 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:38.656571 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:38.664848 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:38.665338 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:38.666118 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:38.666562 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:38.993553 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:39.000919 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-ef43deae-cf37-45fe-9734-fe7159badea7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1211 microversion: 2.1 time: 0.348989 Jul 16 13:09:39.001512 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 577/1168] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:38 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1211 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:40.018211 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:40.019029 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:40.026448 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:40.026994 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:40.027780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:40.028225 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:40.153525 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-1d0b35a0-07c2-4b59-b6b7-ca794bb68fde req-b8e5e18f-976a-4cb6-b239-a07b4f6412bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88eeb252-6e01-41af-adb6-b6d9c5b331e2", "tag": "9314b566-5eca-4660-8a80-f6c701f6e758"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:09:40.163015 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-1d0b35a0-07c2-4b59-b6b7-ca794bb68fde req-b8e5e18f-976a-4cb6-b239-a07b4f6412bb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:40.163464 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-1d0b35a0-07c2-4b59-b6b7-ca794bb68fde req-b8e5e18f-976a-4cb6-b239-a07b4f6412bb service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:40.169235 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:40.183075 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-1d0b35a0-07c2-4b59-b6b7-ca794bb68fde req-b8e5e18f-976a-4cb6-b239-a07b4f6412bb service nova] Creating event network-changed:9314b566-5eca-4660-8a80-f6c701f6e758 for instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 on hv-cinder-83697 Jul 16 13:09:40.183207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-afedacb8-f2ba-4246-afda-776cee580f37 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.166236 Jul 16 13:09:40.183207 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 592/1169] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:40 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:40.190604 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-1d0b35a0-07c2-4b59-b6b7-ca794bb68fde req-b8e5e18f-976a-4cb6-b239-a07b4f6412bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040597 Jul 16 13:09:40.191245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 578/1170] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 16 13:09:41.197849 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:41.198456 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:41.205727 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:41.206184 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:41.206959 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:41.207396 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:41.336540 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:41.344746 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-8db9ade3-0db8-490a-a715-89452a383bc9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.150196 Jul 16 13:09:41.345335 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 593/1171] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:41 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:42.363111 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:42.363812 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:42.369983 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:42.370425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:42.371193 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:42.371628 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:42.500185 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:42.507614 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-04c19c49-d275-428b-8ebb-6fc7d382f81a tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.149810 Jul 16 13:09:42.508175 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 579/1172] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:42 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:43.525022 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:43.525598 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:43.532212 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:43.532662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:43.533461 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:43.533965 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:43.664860 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:43.673478 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-624a0d86-b8d0-416b-85a9-918be2d36d5e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.152255 Jul 16 13:09:43.674050 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 594/1173] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:43 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:44.690940 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:44.691555 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:44.697966 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:44.698411 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:44.699168 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:44.699601 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:44.834109 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:44.841521 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-5aedf061-f23a-458f-8919-85109709f7b3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.155176 Jul 16 13:09:44.842081 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 580/1174] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:44 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:45.858491 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:45.859108 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:45.866320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:45.866770 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:45.867611 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:45.868051 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:45.963547 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=2 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:09:45.983099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell0:SELECT=6 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:09:46.003002 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:46.008013 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1611bb73-cde7-4f14-9a71-57c799baa2e6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.153372 Jul 16 13:09:46.008518 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 595/1175] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:45 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:47.025883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:47.026497 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:47.029025 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell0:SELECT=2 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:09:47.034813 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:47.035262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:47.036028 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:47.036465 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:47.166146 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:47.174019 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-cdedfa85-46cc-41d7-95ec-5143c099ec50 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.152087 Jul 16 13:09:47.174598 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 581/1176] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:47 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:48.190867 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:48.191482 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:48.198407 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:48.198850 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:48.199604 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:48.200033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:48.332532 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:48.340098 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-e001eb44-c522-4719-a094-45404f13a744 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.153214 Jul 16 13:09:48.340667 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 596/1177] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:48 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:49.357415 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:49.358021 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:49.364885 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:49.365353 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:49.366098 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:49.366524 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:49.499341 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:49.507519 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-20b1700a-bed8-45a5-ba31-19de01e3ac1d tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.153895 Jul 16 13:09:49.508071 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 582/1178] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:49 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:50.524702 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:50.525365 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:50.532978 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:50.533447 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:50.534199 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:50.534626 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:50.669910 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:50.679243 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-473b75ac-0386-40d0-b278-486c46b3f3b7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.158411 Jul 16 13:09:50.679810 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 597/1179] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:50 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:51.695593 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:51.696229 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:51.702664 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:51.703899 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:51.704803 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:51.705262 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:51.834739 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:51.842120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-9ba3c7f0-da9c-44bc-93e5-810e9613fcd7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.150337 Jul 16 13:09:51.842686 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 583/1180] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:51 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:52.300674 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [req-7a53eb33-297b-4f2e-9c41-e3a36e8d6ba3 req-97200c5c-fb32-4855-969f-0c48a1410fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88eeb252-6e01-41af-adb6-b6d9c5b331e2", "name": "network-vif-plugged", "status": "completed", "tag": "9314b566-5eca-4660-8a80-f6c701f6e758"}]} {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:09:52.309506 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-7a53eb33-297b-4f2e-9c41-e3a36e8d6ba3 req-97200c5c-fb32-4855-969f-0c48a1410fec service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:52.309941 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [req-7a53eb33-297b-4f2e-9c41-e3a36e8d6ba3 req-97200c5c-fb32-4855-969f-0c48a1410fec service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:52.321571 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.compute.server_external_events [req-7a53eb33-297b-4f2e-9c41-e3a36e8d6ba3 req-97200c5c-fb32-4855-969f-0c48a1410fec service nova] Creating event network-vif-plugged:9314b566-5eca-4660-8a80-f6c701f6e758 for instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 on hv-cinder-83697 Jul 16 13:09:52.326862 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [req-7a53eb33-297b-4f2e-9c41-e3a36e8d6ba3 req-97200c5c-fb32-4855-969f-0c48a1410fec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Jul 16 13:09:52.327780 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 598/1181] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:09:52.860161 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:52.860785 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:52.867291 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:52.867784 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:52.868536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:52.868965 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:53.002366 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:53.009759 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-212009eb-bf97-4a36-be86-1b98ee5d4a04 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.154157 Jul 16 13:09:53.010323 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 584/1182] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:52 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:54.028712 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:54.029470 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:54.037179 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:54.037624 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:54.038373 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:54.038802 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:54.170128 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:54.178146 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-b26694ac-5d33-401c-88af-0212b0fef5e3 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1266 microversion: 2.1 time: 0.153677 Jul 16 13:09:54.178704 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 599/1183] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:54 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:55.194893 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:55.200091 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:55.201968 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:55.202416 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:55.203799 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:55.204234 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:55.337693 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:55.345319 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a7aef244-0314-461b-9b13-e8978b067be7 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1452 microversion: 2.1 time: 0.154300 Jul 16 13:09:55.345883 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 585/1184] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:55 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:55.361826 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:09:55.362473 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:09:55.368868 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:55.369359 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:55.370120 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:55.370556 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:55.502873 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:09:55.510387 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-803785aa-e482-425b-a565-d49907295d80 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1452 microversion: 2.1 time: 0.153163 Jul 16 13:09:55.510946 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 600/1185] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:09:55 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:09:57.426248 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-2d1284ab-3f8a-45b3-ae33-231bfd78c2a8 req-2367e89d-b211-4c92-9998-3cb08224d5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88eeb252-6e01-41af-adb6-b6d9c5b331e2", "tag": "9314b566-5eca-4660-8a80-f6c701f6e758"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:09:57.434654 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-2d1284ab-3f8a-45b3-ae33-231bfd78c2a8 req-2367e89d-b211-4c92-9998-3cb08224d5f9 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:09:57.435101 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-2d1284ab-3f8a-45b3-ae33-231bfd78c2a8 req-2367e89d-b211-4c92-9998-3cb08224d5f9 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:09:57.446242 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-2d1284ab-3f8a-45b3-ae33-231bfd78c2a8 req-2367e89d-b211-4c92-9998-3cb08224d5f9 service nova] Creating event network-changed:9314b566-5eca-4660-8a80-f6c701f6e758 for instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 on hv-cinder-83697 Jul 16 13:09:57.451243 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-2d1284ab-3f8a-45b3-ae33-231bfd78c2a8 req-2367e89d-b211-4c92-9998-3cb08224d5f9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029281 Jul 16 13:09:57.453581 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 586/1186] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:11:47.108573 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR oslo.messaging._drivers.impl_rabbit [-] [190d7c1d-b3b7-4979-ba06-71f9fe0d998a] AMQP server on 10.222.0.47:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 16 13:11:47.109247 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_api:SELECT=24 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:11:47.110032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:47.110436 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG dbcounter [-] [124652] Writing DB stats nova_cell1:SELECT=52 {{(pid=124652) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:11:47.110782 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:47.113752 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:11:47.115488 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG dbcounter [-] [124651] Writing DB stats nova_cell1:SELECT=63 {{(pid=124651) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 16 13:11:47.115609 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-0c911c56-bcdf-4bf5-a6a0-9edba33ec9e6 req-29248147-adc5-43e0-9d0e-38a8479ab88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88eeb252-6e01-41af-adb6-b6d9c5b331e2", "tag": "9314b566-5eca-4660-8a80-f6c701f6e758"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:11:47.121005 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:47.121499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:47.122841 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:47.123288 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:47.124425 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-0c911c56-bcdf-4bf5-a6a0-9edba33ec9e6 req-29248147-adc5-43e0-9d0e-38a8479ab88a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:47.124867 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-0c911c56-bcdf-4bf5-a6a0-9edba33ec9e6 req-29248147-adc5-43e0-9d0e-38a8479ab88a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:47.137857 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-0c911c56-bcdf-4bf5-a6a0-9edba33ec9e6 req-29248147-adc5-43e0-9d0e-38a8479ab88a service nova] Creating event network-changed:9314b566-5eca-4660-8a80-f6c701f6e758 for instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 on hv-cinder-83697 Jul 16 13:11:47.143024 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-0c911c56-bcdf-4bf5-a6a0-9edba33ec9e6 req-29248147-adc5-43e0-9d0e-38a8479ab88a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036734 Jul 16 13:11:47.143841 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 587/1187] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:11:47.150934 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:11:47.450637 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-19801ddb-47f6-4894-899d-84ce483b5a48 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "DELETE /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 204 len: 0 microversion: 2.1 time: 0.346399 Jul 16 13:11:47.453267 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 601/1188] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:11:47 2022] DELETE /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:11:47.460764 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:47.461607 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:47.468520 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:47.468982 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:47.469833 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:47.470352 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:47.632334 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:47.639934 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-8d24706e-c982-4a8d-b738-2b4f200bcbef tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1576 microversion: 2.1 time: 0.183836 Jul 16 13:11:47.640503 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 588/1189] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:47 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:11:48.659577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:48.660276 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:48.667829 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:48.671853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:48.671853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:48.671853 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:48.808929 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:48.816654 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-1e88d853-1aec-4c05-8f4f-92fe3244be6c tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1576 microversion: 2.1 time: 0.161541 Jul 16 13:11:48.817248 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 602/1190] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:48 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:11:49.650060 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-9e9dd4b9-2b10-47d8-926b-f86c1b35d6f9 req-6805f5d4-2bdb-4cec-a7e7-f4e5760bee53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88eeb252-6e01-41af-adb6-b6d9c5b331e2", "name": "network-vif-deleted", "tag": "9314b566-5eca-4660-8a80-f6c701f6e758"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:11:49.660405 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-9e9dd4b9-2b10-47d8-926b-f86c1b35d6f9 req-6805f5d4-2bdb-4cec-a7e7-f4e5760bee53 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:49.660852 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-9e9dd4b9-2b10-47d8-926b-f86c1b35d6f9 req-6805f5d4-2bdb-4cec-a7e7-f4e5760bee53 service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:49.672298 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] [190d7c1d-b3b7-4979-ba06-71f9fe0d998a] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54704. Jul 16 13:11:49.674120 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-9e9dd4b9-2b10-47d8-926b-f86c1b35d6f9 req-6805f5d4-2bdb-4cec-a7e7-f4e5760bee53 service nova] Creating event network-vif-deleted:9314b566-5eca-4660-8a80-f6c701f6e758 for instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 on hv-cinder-83697 Jul 16 13:11:49.678990 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-9e9dd4b9-2b10-47d8-926b-f86c1b35d6f9 req-6805f5d4-2bdb-4cec-a7e7-f4e5760bee53 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Jul 16 13:11:49.679568 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 589/1191] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:11:49.833797 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:49.834402 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:49.840774 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:49.841316 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:49.842033 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:49.842467 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:49.905985 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:49.914706 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-74e6bb88-40b2-42d1-9fd6-f66f37de99c8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 200 len: 1226 microversion: 2.1 time: 0.084448 Jul 16 13:11:49.915290 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 603/1192] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:49 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:11:50.932638 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:50.933423 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 88eeb252-6e01-41af-adb6-b6d9c5b331e2] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:50.939732 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:50.940182 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:50.940939 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:50.941402 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:50.955192 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] HTTP exception thrown: Instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 could not be found. Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Request method failure captured: Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 HTTP/1.1 Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rc14jXwsxSwUYtRBipf0cpgYtDuA7sqq52SFQQyPR_0Cbve5tAN4KCNZVZbmb5yrDkOkInsTgXsCxh1T2aNBIszMmKqiJfF7_gJSi823mWYDu5Czqh1y_S2mnv8RDRySTCoQcdLSNmgUGFovXWQzBTnYoCjPQx43X_3_efSRctEYrA Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 13:11:50.962150 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b0103008c445a5b4b980992a61f4c8", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: f9dc944192d24af0b1e2f64b7e071a3b Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 could not be found. Jul 16 13:11:50.963864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '88eeb252-6e01-41af-adb6-b6d9c5b331e2'} Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 could not be found. Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:11:50.965729 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 could not be found. Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 could not be found. Jul 16 13:11:50.967527 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:50.969748 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Returning 404 to user: Instance 88eeb252-6e01-41af-adb6-b6d9c5b331e2 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:11:50.969748 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-88481909-29f5-4b91-99da-c477e5bef36e tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2" status: 404 len: 111 microversion: 2.1 time: 0.030379 Jul 16 13:11:50.969748 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 590/1193] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:50 2022] GET /compute/v2.1/servers/88eeb252-6e01-41af-adb6-b6d9c5b331e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:11:54.268129 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:54.268635 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:54.271023 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-0c73a897-8a59-41ac-bdf4-e3fa4de234c6 req-acb24674-c534-4903-9ef2-a4c35e70c0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b27ab84-ec2b-4c77-a805-b74bfc345c26", "tag": "f996831a-4275-4280-8411-12aa52a537cf"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:11:54.276049 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:54.276499 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:54.277300 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:54.277967 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:54.281211 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-0c73a897-8a59-41ac-bdf4-e3fa4de234c6 req-acb24674-c534-4903-9ef2-a4c35e70c0ac service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:54.281715 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-0c73a897-8a59-41ac-bdf4-e3fa4de234c6 req-acb24674-c534-4903-9ef2-a4c35e70c0ac service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:54.297442 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-0c73a897-8a59-41ac-bdf4-e3fa4de234c6 req-acb24674-c534-4903-9ef2-a4c35e70c0ac service nova] Creating event network-changed:f996831a-4275-4280-8411-12aa52a537cf for instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 on hv-cinder-83697 Jul 16 13:11:54.302838 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-0c73a897-8a59-41ac-bdf4-e3fa4de234c6 req-acb24674-c534-4903-9ef2-a4c35e70c0ac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035734 Jul 16 13:11:54.304579 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 591/1194] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:11:54.306116 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Going to try to terminate instance {{(pid=124651) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 16 13:11:54.596726 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-5ccfd602-4b75-4247-80a1-b37f98d6d8a8 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 204 len: 0 microversion: 2.1 time: 0.332142 Jul 16 13:11:54.597619 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 604/1195] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:11:54 2022] DELETE /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 16 13:11:54.607043 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:54.607845 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:54.614297 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:54.615055 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:54.616699 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:54.617659 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:54.798508 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:54.806892 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-f23643a7-ed00-4212-9730-326d70a9e328 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1576 microversion: 2.1 time: 0.204112 Jul 16 13:11:54.807488 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 592/1196] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:54 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:11:55.824966 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:55.825682 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:55.832008 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:55.832451 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:55.833231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:55.833662 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:56.023359 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:56.030874 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-ad922c27-ca97-4cc4-bf27-523f0b00e263 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1457 microversion: 2.1 time: 0.210129 Jul 16 13:11:56.031431 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 605/1197] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:55 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1457 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:11:57.013284 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [req-7d713510-da87-4988-9e3a-0c972a6425e3 req-0920c8d1-67f1-4e93-9abd-5ac25ed1915a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b27ab84-ec2b-4c77-a805-b74bfc345c26", "name": "network-vif-deleted", "tag": "f996831a-4275-4280-8411-12aa52a537cf"}]} {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 16 13:11:57.021589 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-7d713510-da87-4988-9e3a-0c972a6425e3 req-0920c8d1-67f1-4e93-9abd-5ac25ed1915a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:57.022165 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [req-7d713510-da87-4988-9e3a-0c972a6425e3 req-0920c8d1-67f1-4e93-9abd-5ac25ed1915a service nova] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:57.033251 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.compute.server_external_events [req-7d713510-da87-4988-9e3a-0c972a6425e3 req-0920c8d1-67f1-4e93-9abd-5ac25ed1915a service nova] Creating event network-vif-deleted:f996831a-4275-4280-8411-12aa52a537cf for instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 on hv-cinder-83697 Jul 16 13:11:57.038658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [req-7d713510-da87-4988-9e3a-0c972a6425e3 req-0920c8d1-67f1-4e93-9abd-5ac25ed1915a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029091 Jul 16 13:11:57.039546 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 593/1198] 10.222.0.47 () {64 vars in 1317 bytes} [Sat Jul 16 13:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 16 13:11:57.047648 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:57.048269 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:57.055776 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:57.056231 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:57.057012 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:57.057491 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:57.122271 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.policy [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124651) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:57.129999 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-6356d43d-c130-45da-8126-3cee7f43a123 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1390 microversion: 2.1 time: 0.086302 Jul 16 13:11:57.130566 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 606/1199] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:57 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 16 13:11:58.148328 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:58.149019 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:58.155131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:58.155569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:58.156316 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:58.156747 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:58.188419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:58.188864 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:58.189337 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.objects.instance [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lazy-loading 'fault' on Instance uuid 7b27ab84-ec2b-4c77-a805-b74bfc345c26 {{(pid=124652) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 16 13:11:58.231801 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.policy [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9dc944192d24af0b1e2f64b7e071a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b0103008c445a5b4b980992a61f4c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124652) authorize /opt/stack/nova/nova/policy.py:199}} Jul 16 13:11:58.238536 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-df9247f3-3088-4af8-abf0-f9c955d0cdc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 200 len: 1184 microversion: 2.1 time: 0.094946 Jul 16 13:11:58.241462 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 594/1200] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:58 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 1184 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 16 13:11:59.256435 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:59.257007 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 7b27ab84-ec2b-4c77-a805-b74bfc345c26] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:59.264085 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:59.264508 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:59.265320 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:59.265751 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:59.279322 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] HTTP exception thrown: Instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 could not be found. Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Request method failure captured: Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 HTTP/1.1 Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rc14jXwsxSwUYtRBipf0cpgYtDuA7sqq52SFQQyPR_0Cbve5tAN4KCNZVZbmb5yrDkOkInsTgXsCxh1T2aNBIszMmKqiJfF7_gJSi823mWYDu5Czqh1y_S2mnv8RDRySTCoQcdLSNmgUGFovXWQzBTnYoCjPQx43X_3_efSRctEYrA Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 13:11:59.280970 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b0103008c445a5b4b980992a61f4c8", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f9dc944192d24af0b1e2f64b7e071a3b Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 could not be found. Jul 16 13:11:59.282710 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '7b27ab84-ec2b-4c77-a805-b74bfc345c26'} Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 could not be found. Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:11:59.283628 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 could not be found. Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 could not be found. Jul 16 13:11:59.285319 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.287032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Returning 404 to user: Instance 7b27ab84-ec2b-4c77-a805-b74bfc345c26 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:11:59.287032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-678aa652-dd3f-4d94-a798-cddada43be28 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26" status: 404 len: 111 microversion: 2.1 time: 0.029864 Jul 16 13:11:59.287032 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 607/1201] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:59 2022] GET /compute/v2.1/servers/7b27ab84-ec2b-4c77-a805-b74bfc345c26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:11:59.771569 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:59.772048 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.compute.api [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124652) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:59.778712 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:59.779159 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:59.779916 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:59.780350 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG oslo_concurrency.lockutils [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124652) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:59.794139 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.wsgi [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] HTTP exception thrown: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Request method failure captured: Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: request: DELETE /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 HTTP/1.1 Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept: application/json Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Accept-Encoding: identity Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Connection: close Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Length: 0 Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Content-Type: application/json Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Host: 10.222.0.47 Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Openstack-System-Scope: None Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: User-Agent: python-urllib3/1.26.9 Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Auth-Token: gAAAAABi0rc14jXwsxSwUYtRBipf0cpgYtDuA7sqq52SFQQyPR_0Cbve5tAN4KCNZVZbmb5yrDkOkInsTgXsCxh1T2aNBIszMmKqiJfF7_gJSi823mWYDu5Czqh1y_S2mnv8RDRySTCoQcdLSNmgUGFovXWQzBTnYoCjPQx43X_3_efSRctEYrA Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Id: None Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Domain-Name: None Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Identity-Status: Confirmed Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Is-Admin-Project: True Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Id: default Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Domain-Name: Default Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Project-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Role: member,reader Jul 16 13:11:59.795820 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Roles: member,reader Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b0103008c445a5b4b980992a61f4c8", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Id: default Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Domain-Name: Default Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Id: f9dc944192d24af0b1e2f64b7e071a3b Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: X-User-Name: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: method: > Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: exception: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.797690 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: action_args: {'id': '2a3e0470-ac23-406d-a795-edd806fcbd05'} Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:11:59.798817 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.800492 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.802245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Returning 404 to user: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. {{(pid=124652) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:11:59.802245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-6e344107-ccf0-431a-86b9-357f82b8d2e9 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 404 len: 111 microversion: 2.1 time: 0.029570 Jul 16 13:11:59.802245 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 595/1202] 10.222.0.47 () {58 vars in 1238 bytes} [Sat Jul 16 13:11:59 2022] DELETE /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 16 13:11:59.807076 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '>' {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:11:59.807678 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.compute.api [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [instance: 2a3e0470-ac23-406d-a795-edd806fcbd05] Fetching instance by UUID {{(pid=124651) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 16 13:11:59.813599 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:59.814039 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:59.814786 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 16 13:11:59.815213 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG oslo_concurrency.lockutils [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Lock "7da9c633-d1e3-4a76-a464-f6bb00d1ecba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124651) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 16 13:11:59.832099 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.wsgi [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] HTTP exception thrown: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Request method failure captured: Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: request: GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 HTTP/1.1 Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept: application/json Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Accept-Encoding: identity Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Connection: close Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Length: 0 Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Content-Type: application/json Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Host: 10.222.0.47 Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Openstack-System-Scope: None Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: User-Agent: python-urllib3/1.26.9 Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Auth-Token: gAAAAABi0rc14jXwsxSwUYtRBipf0cpgYtDuA7sqq52SFQQyPR_0Cbve5tAN4KCNZVZbmb5yrDkOkInsTgXsCxh1T2aNBIszMmKqiJfF7_gJSi823mWYDu5Czqh1y_S2mnv8RDRySTCoQcdLSNmgUGFovXWQzBTnYoCjPQx43X_3_efSRctEYrA Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Id: None Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Domain-Name: None Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Identity-Status: Confirmed Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Is-Admin-Project: True Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Id: default Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Domain-Name: Default Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Project-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Role: member,reader Jul 16 13:11:59.833632 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Roles: member,reader Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_57b0103008c445a5b4b980992a61f4c8", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/57b0103008c445a5b4b980992a61f4c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Id: 57b0103008c445a5b4b980992a61f4c8 Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-Tenant-Name: tempest-TestVolumeBootPattern-2077167934 Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Id: default Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Domain-Name: Default Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Id: f9dc944192d24af0b1e2f64b7e071a3b Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: X-User-Name: tempest-TestVolumeBootPattern-2077167934-project Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: method: > Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: exception: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.835427 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: action_args: {'id': '2a3e0470-ac23-406d-a795-edd806fcbd05'} Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: {{(pid=124651) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 16 13:11:59.836459 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. Jul 16 13:11:59.843579 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: ERROR nova.api.openstack.wsgi Jul 16 13:11:59.845081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: DEBUG nova.api.openstack.wsgi [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Returning 404 to user: Instance 2a3e0470-ac23-406d-a795-edd806fcbd05 could not be found. {{(pid=124651) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 16 13:11:59.845081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO nova.api.openstack.requestlog [None req-76f8ed97-5920-4ea4-aa05-8d166567abc6 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05" status: 404 len: 111 microversion: 2.1 time: 0.032569 Jul 16 13:11:59.845081 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: [pid: 124651|app: 0|req: 608/1203] 10.222.0.47 () {58 vars in 1235 bytes} [Sat Jul 16 13:11:59 2022] GET /compute/v2.1/servers/2a3e0470-ac23-406d-a795-edd806fcbd05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 16 13:12:01.340209 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: DEBUG nova.api.openstack.wsgi [None req-a79fa046-9034-490d-88aa-307fce1bd397 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] Calling method '.version_select at 0x7f6cf8acc0d0>' {{(pid=124652) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 16 13:12:01.343330 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a79fa046-9034-490d-88aa-307fce1bd397 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [069b0065-c30c-46cd-a5ab-c2f51cc1163a] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 16 13:12:02.352559 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [None req-a79fa046-9034-490d-88aa-307fce1bd397 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] [069b0065-c30c-46cd-a5ab-c2f51cc1163a] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 54764. Jul 16 13:12:02.433850 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO nova.api.openstack.requestlog [None req-a79fa046-9034-490d-88aa-307fce1bd397 tempest-TestVolumeBootPattern-2077167934 tempest-TestVolumeBootPattern-2077167934-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546483731" status: 202 len: 0 microversion: 2.1 time: 1.097494 Jul 16 13:12:02.434419 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: [pid: 124652|app: 0|req: 596/1204] 10.222.0.47 () {58 vars in 1262 bytes} [Sat Jul 16 13:12:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1546483731 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 16 13:12:24.300993 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:12:24.301592 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:12:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:12:27.453658 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:12:27.454273 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:12:29.215460 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:12:29.215948 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:12:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:14:27.811516 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:14:27.812302 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:14:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:15:44.309577 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:15:44.310223 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:15:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:15:47.463499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:15:47.464102 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:15:49.223031 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:15:49.223552 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:17:19.823499 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:17:19.824131 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:17:45.724104 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:17:45.724716 dv-cinder-836973-12-iscsi devstack@n-api.service[124652]: Sat Jul 16 13:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 16 13:17:47.820495 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 16 13:17:47.821162 dv-cinder-836973-12-iscsi devstack@n-api.service[124651]: Sat Jul 16 13:17:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!